Sign up to access all features of our service
  • Job search
  • Favorites
  • Create a CV
    New
  • Salaries
  • Subscriptions

AI Systems Architect - LLM & Vector Infrastructure

Starmarkets

We are seeking a senior AI Systems Architect to design and implement AI-native application cores where Large Language Models (LLMs), vector databases, retrieval systems, and agent frameworks form the primary computational layer of our web and mobile applications.

This role is responsible for architecting scalable AI pipelines, retrieval-augmented generation (RAG) systems, memory architectures, AI agents, and orchestration workflows integrated with our development stack (Web, Mobile, n8n automation, and AI services).

The ideal candidate understands that AI is not a feature, it is the operating system of the product.

Key Responsibilities

1. AI Core Architecture Design

  • Design AI-first system architecture for web and mobile applications
  • Architect RAG pipelines using vector databases
  • Define long-term memory, short-term memory, and contextual state systems
  • Implement multi-agent AI systems
  • Design AI orchestration layers

2. Vector Database & Embedding Systems

  • Select and implement vector databases such as:
    • Pinecone
    • Weaviate
    • Qdrant
    • Milvus
    • Supabase (pgvector)
  • Optimize embedding strategies
  • Implement hybrid search (semantic + keyword)
  • Design scalable indexing pipelines

3. LLM Integration & Optimization

  • Work with models such as:
    • OpenAI APIs
    • Anthropic
    • Meta (LLaMA)
    • DeepSeek
    • Alibaba (Qwen)
  • Implement structured output pipelines
  • Design evaluation and prompt testing frameworks
  • Optimize cost-performance ratio

4. AI Agent Systems & Orchestration

  • Build autonomous AI agents
  • Design tool-calling systems
  • Integrate with:
    • n8n
    • LangGraph / LangChain style agent flows
  • Implement memory-aware agents

5. Production AI Engineering

  • Build monitoring systems for hallucination detection
  • Design guardrails and validation layers
  • Implement evaluation datasets and benchmarking
  • Ensure security of AI pipelines
  • Build scalable infrastructure (Docker, Kubernetes, GPU optimization)

Technical Expertise

  • 5+ years software engineering experience
  • 2+ years building production AI systems
  • Deep knowledge of:
    • Vector embeddings & similarity search
    • RAG architectures
    • Tokenization and context window optimization
    • Fine-tuning & LoRA concepts
    • Prompt evaluation frameworks
  • Experience with Python (mandatory)
  • Experience with FastAPI / backend services
  • Experience designing scalable APIs

Architecture Experience

  • Designing distributed systems
  • Microservices & event-driven architecture
  • Experience with PostgreSQL + pgvector
  • Experience deploying LLM systems in production
#J-18808-Ljbffr

Vacancy posted 2 days ago
Similar jobs that could be interesting for youBased on the AI Systems Architect - LLM & Vector Infrastructure in Riyadh vacancy
  •  ...Starmarkets seeks a senior AI Systems Architect to design AI-native cores for web and mobile apps, leveraging LLMs, vector databases, and agent frameworks. You will shape scalable AI pipelines, RAG systems, memory architectures, and orchestration workflows that power our... 

    Starmarkets

    Riyadh
    2 days ago
  •  ...through cutting‑edge AI, computer vision,...  ...local talent and infrastructure, advancing the...  ...seeking an AI Solution Architect to translate...  ...secure enterprise AI system blueprints. This...  ...select optimal LLMs, vector stores, and...  ..., and open‑source LLM frameworks ~ Strong... 

    CreditNinja - KMD Partners, LLC

    Riyadh
    12 hours ago
  •  ...enterprise-grade agentic AI across the Middle...  ...production AI systems before and can...  ...directly alongside architects, designers, and AI...  ...generation, including vectors, keyword-...  ...pipeline YAML, with infrastructure-as-code (Bicep or...  ...and evaluation of LLM applications ➤ Exposure... 

    Sulava MEA

    Riyadh
    a month ago
  •  ...InnovationTeam is seeking a Senior Generative AI (GenAI) Engineer in Riyadh, Saudi Arabia. The role involves designing and deploying large-scale generative AI solutions, collaborating with cross-functional teams to meet business needs. The ideal candidate will have... 

    InnovationTeam

    Riyadh
    4 days ago
  •  ...future and provides tailored AI-powered, end-to-end solutions...  ...LangChain, Jupyter, MLflow , vector databases, RAG architectures,...  ...Agentic AI, GenAI/ML platforms, LLM models. Data Platform Skills...  ...Knowledge: Deep experience in architecting Data & AI use cases for Government... 
    Riyadh
    26 days ago
  •  ...We are the AI Hub delivering advisory services focused on data architecture and data-driven transformation.  We work closely with...  ...AWS listed as a commonly requested certification for senior data architect profiles)  ~ CDMP (Certified Data Management Professional)... 

    Ernst & Young

    Riyadh
    12 days ago
  •  ...Arenaestadios is seeking a Senior Sports Architect in Riyadh, Saudi Arabia. This role focuses on delivering major sports infrastructure projects, ensuring compliance with International Federation standards during design and construction phases. The ideal candidate... 

    Arenaestadios

    Riyadh
    2 days ago
  •  ...S&P Global Energy seeks a Solutions Architect, AI & Delivery Enablement (Energy) to bridge customers, internal teams, and product development in delivering AI-enabled energy workflows and data solutions. You translate energy objectives into architecture, support prototypes... 

    S&P Global, Inc.

    Riyadh
    12 hours ago
  •  ...AI Solution Architect – NTT DATA As an AI Solution Architect at NTT Data, you will play a critical role in driving AI‑led growth and transformation across a designated mega account or regional portfolio within the Financial Services and Retail sectors. You will work... 

    NTT Limited

    Riyadh
    2 days ago
  •  ...Information Technology Company LLC is seeking experienced Senior/Staff Software Engineers to build and operate rack management software for AI accelerators in large-scale data centers. You will own provisioning, monitoring, and lifecycle management, interfacing with BMCs,... 

    Qualcomm

    Riyadh
    4 days ago
  •  ...solutions and integrating modern AI capabilities into enterprise...  ...in backend development, systems integration, and application deployment...  ..., analytics services, RAG/LLM capabilities, and monitoring components...  ...and close collaboration with architects, frontend engineers, DevOps,... 

    SoftwareOne

    Riyadh
    1 day ago
  •  ...detail-oriented OCP Networking Architect to join one of our clients' teams...  ...working with the PCB team and System Architects to drive OCP based...  ...Good understanding of datacenter infrastructure and management support  ~ Knowledge of AI datacenter needs and requirements... 

    TechBiz Global GmbH

    Riyadh
    2 days ago
  •  ...Job Description – System Engineer Position: System Engineer Project Duration: 3 Months Location: Onsite Language:...  ...Responsibilities Design system architecture. Configure servers and infrastructure. Install and maintain applications. Monitor system... 

    Datamatics Technologies

    Riyadh
    6 days ago
  •  ...Veeam is the Data and AI Trust Company, specializing in helping organizations...  ...customers, working with Veeam Solution Architects, System Integrators, and Professional Services...  ...gathering and understanding existing infrastructure. Knowledge in V m ware , Nutanix... 

    Veeam Software

    Riyadh
    more than 2 months ago
  •  ...we build what millions depend on daily - rail transportation systems that can't afford to fail. We're more than 85 000 people worldwide...  ...Manager, you will be at the heart of delivering a critical infrastructure project for RIyadh's growing metro network. What you bring... 

    Alstom

    Riyadh
    13 days ago
  • AI Engineer to ERP and Digital Operations (DFF OPS) Region: Riyadh Role Overview: We...  ...Power BI, M365 Graph. Experience with RAG, vector databases (pgvector, FAISS), Streamlit/fastAPI...  ...RFQ→Quote automation or B2B procurement systems. Background in manufacturing/lighting or... 

    Private Company

    Riyadh
    a month ago
  •  ...and contracting Job Description Design, develop, and test electrical systems and components to meet performance, safety, and regulatory requirements across product and infrastructure projects. Key Performance Indicators: • Deliver electrical designs meeting specifications... 

    Jobs for Humanity

    Riyadh
    7 days ago
  •  ...Senior Geospatial AI Specialist Grade: 6 Location: Riyadh...  ...Arabia JOB PURPOSE BAE Systems is the UK Government’s nominated...  ...from satellite imagery, vector data, and other geospatial datasets...  ...critical information and infrastructure secure. All appointments in... 

    BAE Systems

    Riyadh
    more than 2 months ago
  •  ...administering, maintaining, and supporting the organization's IT infrastructure, including Microsoft Exchange, Active Directory, Windows...  ...and VMware virtualization environment. The role ensures high system availability, security, and performance while providing technical... 

    Prime Gate

    Riyadh
    21 days ago
  •  ...We are looking for a Solution Architect / Software Architect to...  ...scalable, secure, and efficient systems. The architect will collaborate...  ...and frameworks. 2. Cloud & Infrastructure Architecture • Design cloud...  ...Experience with Streaming & AI Workloads: Knowledge of real-... 

    Prime Gate

    Riyadh
    more than 2 months ago
  •  ...We are looking for a Deployment Engineer & Architect to lead the design, development, and deployment of AI agent solutions using Microsoft Copilot, Copilot Studio...  ...Copilot Studio and integrate with enterprise systems Develop custom plugins, connectors, and workflows... 

    Sulava MEA

    Riyadh
    a month ago
  •  ...Job Description We are seeking an experienced Facade Architect to join our team in Riyadh, Saudi Arabia. In this role, you will...  ...oversee the design, engineering, and on-site supervision of facade systems for commercial and residential projects. You will be... 

    Egis Group

    Riyadh
    18 days ago
  •  ...real estate ventures. With expertise in engineering, architecture, and technology, Egis shapes the future of urban spaces and infrastructure. The position will play a key role in driving these visionary projects forward, focusing on the strategic and technical aspects... 

    Egis Group

    Riyadh
    1 day ago
  •  ...applying. Job Description – MLOps Architect / Engineer (0–12+ Years Experience...  ..., Kubernetes, CI/CD automation, Infrastructure as Code (IaC), and enterprise AI platform engineering to enable...  ...lifecycle management and production AI systems. Experience designing cloud-... 

    Datamatics Technologies

    Riyadh
    6 days ago
  •  ...Job Summary A System Engineer specializing in the design, administration, and maintenance of IT infrastructure, servers, and operating systems. Responsible for ensuring system availability, performance optimization, security, and reliability. The role includes managing... 

    Prime Gate

    Riyadh
    more than 2 months ago
  •  ...carefully berore applying. Job Description – AI / ML Engineer  | 0–12+ Years Experience...  ...or PyTorch Generative AI & LLM Frameworks ~ HuggingFace or LangChain...  ...leadership. Collaborate with enterprise architects, product owners, and business leaders.... 

    Datamatics Technologies

    Riyadh
    6 days ago
  •  ...exciting challenges for our customers, at the intersection of AI/ML and cutting-edge cloud infrastructure, with NLP being a core area of what we do and what we...  .../Answering or related fields ~ Experience in LLM reasoning, ACT, and ReACT methods ~ Experience in developing... 

    aiXplain

    Riyadh
    more than 2 months ago
  •  ...Job Summary We are seeking Cloud Architect/Engineer professionals for our Riyadh office...  ...using standard checklists and Infrastructure as Code modules, including Terraform....  ...Computer Science, Engineering, Information Systems, or a related discipline, or equivalent... 

    Ernst & Young

    Riyadh
    14 days ago
  • $6500 - $7000 per month

     ...regulations like GDPR.  This role designs the technical infrastructure that supports data governance initiatives, from data modeling...  ..., such as data catalogs and workflow management systems.  Data quality and lineage: Establish and monitor data quality... 

    Compunet Connections

    Riyadh
    more than 2 months ago
  •  ...and method statements. Coordinate with multidisciplinary teams including Urban Planning, Landscape, Structural, MEP, BIM, and Infrastructure disciplines. Conduct site inspections to monitor construction quality, design compliance, and adherence to approved drawings... 

    ASSYSTEM

    Riyadh
    19 days ago

Do you want to receive more vacancies?

Subscribe and receive similar vacancies to AI Systems Architect - LLM & Vector Infrastructure. Be the first to apply!