Talent.com
LLM Engineer

LLM Engineer

AkkodisToronto, ON, Canada
3 days ago
Job type
  • Full-time
Job description

Akkodis is partnered with a global leading IT management & Technology firm who specialize in delivering cutting-edge data solutions for high-impact projects. They're seeking a highly skilled LLM Engineer to join their team here in Toronto.

In this role, you will be responsible for designing and developing scalable software solutions, leading archicture design, and ensuring the performance and reliability of LLM-based solutions.

Responsibilities include :

  • Take ownership of architecture design and development of scalable and distributed software systems.
  • Translate business to technical requirements
  • Own technical execution, ensuring code quality, adherence to deadlines, and efficient resource allocation
  • Data driven decision making skills with focus on achieving product goals
  • Design, develop and deploy LLM based pipelines involving patterns like RAG, Agentic workflows, PEFT (e.g. LORA, QLORA, etc.)
  • Responsible for the complete software development lifecycle, including requirements analysis, design, coding, testing, and deployment.
  • Utilize AWS services / Azure services like IAM, Monitoring, Load Balancing, Autoscaling, Database, Networking, storage, ECR, AKS, ACR etc.
  • Implement DevOps practices using tools like Docker, Kubernetes to ensure continuous integration and delivery. Develop DevOps scripts for automation and monitoring.
  • Collaborate with cross-functional teams, conduct code reviews, and provide guidance on software design and best practices.

The ideal candidate will have a combination of the below technical skills :

  • Bachelor’s degree in computer science, Information Technology, or a related field (or equivalent work experience).
  • At least 5 years of experience in software development, with relevant work experience in LLM app development.
  • Strong coding skills with proficiency in Python and Javascript
  • Experience with API frameworks both stateless and p such as Fast API, Django
  • Well versed in implementation of web sockets, gRPC, access management using JWT (Azure AD, IDM preferred)
  • Proficient in cloud platforms, specifically AWS, Azure, or GCP
  • Knowledge and hands-on experience with front-end development (React JS, Next JS, Tailwind CSS) preferred
  • Strong experience in LLM patterns like RAG, Vector DB, Hybrid Search, Agent development, Agentic workflows, prompt engineering, etc.
  • Strong experience with LLM APIs (Open AI, Anthropic, AWS Bedrock), SDKs (Langchain, DSPy)
  • Hands-on experience with DevOps tools including Docker, Kubernetes, and AWS services (Redshift, RDS, S3).
  • Experience in production deployments involving thousands of users
  • Strong understanding of scalable application design principles and experience with security best practices and compliance with privacy regulations.
  • Good knowledge of software engineering practices like version control (GIT), DevOps (Azure DevOps preferred) and Agile or Scrum.
  • Experience of SDLC and best practices while development
  • Experience with Agile methodology for continuous product development and delivery

    • If you are interested in learning more or if you would like to discuss any other ML or LLM Engineer related roles, don't hesitate to apply today!