ellipse center banner

AI Data Engineer

Job Description

We are looking for a Data Engineer to design and build scalable data pipelines and AI-driven data systems. The role involves developing batch and streaming ETL/ELT pipelines, implementing RAG (Retrieval-Augmented Generation) architectures, and working with vector databases and unstructured data.

Key Roles
  • Design and build batch & streaming ETL/ELT pipelines from scratch .
  • Develop and optimize RAG pipelines for AI applications .
  • Implement document ingestion frameworks for PDF, DOCX, and unstructured data.
  • Build and manage vector search systems (OpenSearch / Pinecone) .
  • Create and expose data APIs for AI/ML applications.
  • Own end-to-end pipeline lifecycle (design ? development ? deployment ? monitoring) .
  • Architect and implement scalable data solutions using AWS services.
  • Collaborate with AI/ML teams to support LLM-based use cases.
  • Ensure data quality, performance, and observability using monitoring tools.
Eligibility Criteria
  • 5–7+ years of hands-on Data Engineering experience at scale.
  • Strong expertise in Python (advanced), SQL, Spark / Spark SQL, ETL/ELT pipeline development (batch & streaming) .
  • Deep understanding of: RAG architecture and workflows, Embeddings, vector databases, semantic search.
  • Hands-on experience with AWS services: S3, Lambda, Athena, Step Functions, API Gateway, DynamoDB, CloudWatch, AWS Glue, Bedrock (preferred) .
  • Experience working with unstructured data transformation (PDF, DOCX) .
  • Strong knowledge of Docker (containerization) .
  • Experience with CI/CD tools (Jenkins, Git/Bitbucket) .
Why Space Inventive?

At Space, we're not just building software; we're crafting digital solutions that redefine industries. We believe in the power of technology to transform businesses and lives. Our culture is one of innovation, collaboration, and a relentless pursuit of excellence. We foster an environment where ideas are nurtured, and potential is maximized.

Joining Space means becoming part of a dynamic team that's at the forefront of technological advancements.You'll have the opportunity to work on challenging and rewarding projects, alongside some of the brightest minds in the industry. We offer a competitive compensation package, comprehensive benefits, and ample opportunities for professional growth.

But what truly sets us apart is our commitment to our employees. We believe in investing in our people, providing them with the tools, resources, and support they need to succeed. We encourage a healthy work-life balance and promote a positive and inclusive workplace culture. If you're passionate about technology and eager to make a meaningful impact, Space is the place for you.