AI Systems Architect - LLM & Vector Infrastructure
Starmarkets
We are seeking a senior AI Systems Architect to design and implement AI-native application cores where Large Language Models (LLMs), vector databases, retrieval systems, and agent frameworks form the primary computational layer of our web and mobile applications.
This role is responsible for architecting scalable AI pipelines, retrieval-augmented generation (RAG) systems, memory architectures, AI agents, and orchestration workflows integrated with our development stack (Web, Mobile, n8n automation, and AI services).
The ideal candidate understands that AI is not a feature, it is the operating system of the product.
Key Responsibilities
1. AI Core Architecture Design
- Design AI-first system architecture for web and mobile applications
- Architect RAG pipelines using vector databases
- Define long-term memory, short-term memory, and contextual state systems
- Implement multi-agent AI systems
- Design AI orchestration layers
2. Vector Database & Embedding Systems
- Select and implement vector databases such as:
- Pinecone
- Weaviate
- Qdrant
- Milvus
- Supabase (pgvector)
- Optimize embedding strategies
- Implement hybrid search (semantic + keyword)
- Design scalable indexing pipelines
3. LLM Integration & Optimization
- Work with models such as:
- OpenAI APIs
- Anthropic
- Meta (LLaMA)
- DeepSeek
- Alibaba (Qwen)
- Implement structured output pipelines
- Design evaluation and prompt testing frameworks
- Optimize cost-performance ratio
4. AI Agent Systems & Orchestration
- Build autonomous AI agents
- Design tool-calling systems
- Integrate with:
- n8n
- LangGraph / LangChain style agent flows
- Implement memory-aware agents
5. Production AI Engineering
- Build monitoring systems for hallucination detection
- Design guardrails and validation layers
- Implement evaluation datasets and benchmarking
- Ensure security of AI pipelines
- Build scalable infrastructure (Docker, Kubernetes, GPU optimization)
Technical Expertise
- 5+ years software engineering experience
- 2+ years building production AI systems
- Deep knowledge of:
- Vector embeddings & similarity search
- RAG architectures
- Tokenization and context window optimization
- Fine-tuning & LoRA concepts
- Prompt evaluation frameworks
- Experience with Python (mandatory)
- Experience with FastAPI / backend services
- Experience designing scalable APIs
Architecture Experience
- Designing distributed systems
- Microservices & event-driven architecture
- Experience with PostgreSQL + pgvector
- Experience deploying LLM systems in production
- ...Starmarkets seeks a senior AI Systems Architect to design AI-native cores for web and mobile apps, leveraging LLMs, vector databases, and agent frameworks. You will shape scalable AI pipelines, RAG systems, memory architectures, and orchestration workflows that power our...
- ...through cutting‑edge AI, computer vision,... ...local talent and infrastructure, advancing the... ...seeking an AI Solution Architect to translate... ...secure enterprise AI system blueprints. This... ...select optimal LLMs, vector stores, and... ..., and open‑source LLM frameworks ~ Strong...
- ...enterprise-grade agentic AI across the Middle... ...production AI systems before and can... ...directly alongside architects, designers, and AI... ...generation, including vectors, keyword-... ...pipeline YAML, with infrastructure-as-code (Bicep or... ...and evaluation of LLM applications ➤ Exposure...
- ...InnovationTeam is seeking a Senior Generative AI (GenAI) Engineer in Riyadh, Saudi Arabia. The role involves designing and deploying large-scale generative AI solutions, collaborating with cross-functional teams to meet business needs. The ideal candidate will have...
- ...future and provides tailored AI-powered, end-to-end solutions... ...LangChain, Jupyter, MLflow , vector databases, RAG architectures,... ...Agentic AI, GenAI/ML platforms, LLM models. Data Platform Skills... ...Knowledge: Deep experience in architecting Data & AI use cases for Government...
- ...We are the AI Hub delivering advisory services focused on data architecture and data-driven transformation. We work closely with... ...AWS listed as a commonly requested certification for senior data architect profiles) ~ CDMP (Certified Data Management Professional)...
- ...Arenaestadios is seeking a Senior Sports Architect in Riyadh, Saudi Arabia. This role focuses on delivering major sports infrastructure projects, ensuring compliance with International Federation standards during design and construction phases. The ideal candidate...
- ...S&P Global Energy seeks a Solutions Architect, AI & Delivery Enablement (Energy) to bridge customers, internal teams, and product development in delivering AI-enabled energy workflows and data solutions. You translate energy objectives into architecture, support prototypes...
- ...AI Solution Architect – NTT DATA As an AI Solution Architect at NTT Data, you will play a critical role in driving AI‑led growth and transformation across a designated mega account or regional portfolio within the Financial Services and Retail sectors. You will work...
- ...Information Technology Company LLC is seeking experienced Senior/Staff Software Engineers to build and operate rack management software for AI accelerators in large-scale data centers. You will own provisioning, monitoring, and lifecycle management, interfacing with BMCs,...
- ...solutions and integrating modern AI capabilities into enterprise... ...in backend development, systems integration, and application deployment... ..., analytics services, RAG/LLM capabilities, and monitoring components... ...and close collaboration with architects, frontend engineers, DevOps,...
- ...detail-oriented OCP Networking Architect to join one of our clients' teams... ...working with the PCB team and System Architects to drive OCP based... ...Good understanding of datacenter infrastructure and management support ~ Knowledge of AI datacenter needs and requirements...
- ...Job Description – System Engineer Position: System Engineer Project Duration: 3 Months Location: Onsite Language:... ...Responsibilities Design system architecture. Configure servers and infrastructure. Install and maintain applications. Monitor system...
- ...Veeam is the Data and AI Trust Company, specializing in helping organizations... ...customers, working with Veeam Solution Architects, System Integrators, and Professional Services... ...gathering and understanding existing infrastructure. Knowledge in V m ware , Nutanix...
- ...we build what millions depend on daily - rail transportation systems that can't afford to fail. We're more than 85 000 people worldwide... ...Manager, you will be at the heart of delivering a critical infrastructure project for RIyadh's growing metro network. What you bring...
- AI Engineer to ERP and Digital Operations (DFF OPS) Region: Riyadh Role Overview: We... ...Power BI, M365 Graph. Experience with RAG, vector databases (pgvector, FAISS), Streamlit/fastAPI... ...RFQ→Quote automation or B2B procurement systems. Background in manufacturing/lighting or...
- ...and contracting Job Description Design, develop, and test electrical systems and components to meet performance, safety, and regulatory requirements across product and infrastructure projects. Key Performance Indicators: • Deliver electrical designs meeting specifications...
- ...Senior Geospatial AI Specialist Grade: 6 Location: Riyadh... ...Arabia JOB PURPOSE BAE Systems is the UK Government’s nominated... ...from satellite imagery, vector data, and other geospatial datasets... ...critical information and infrastructure secure. All appointments in...
- ...administering, maintaining, and supporting the organization's IT infrastructure, including Microsoft Exchange, Active Directory, Windows... ...and VMware virtualization environment. The role ensures high system availability, security, and performance while providing technical...
- ...We are looking for a Solution Architect / Software Architect to... ...scalable, secure, and efficient systems. The architect will collaborate... ...and frameworks. 2. Cloud & Infrastructure Architecture • Design cloud... ...Experience with Streaming & AI Workloads: Knowledge of real-...
- ...We are looking for a Deployment Engineer & Architect to lead the design, development, and deployment of AI agent solutions using Microsoft Copilot, Copilot Studio... ...Copilot Studio and integrate with enterprise systems Develop custom plugins, connectors, and workflows...
- ...Job Description We are seeking an experienced Facade Architect to join our team in Riyadh, Saudi Arabia. In this role, you will... ...oversee the design, engineering, and on-site supervision of facade systems for commercial and residential projects. You will be...
- ...real estate ventures. With expertise in engineering, architecture, and technology, Egis shapes the future of urban spaces and infrastructure. The position will play a key role in driving these visionary projects forward, focusing on the strategic and technical aspects...
- ...applying. Job Description – MLOps Architect / Engineer (0–12+ Years Experience... ..., Kubernetes, CI/CD automation, Infrastructure as Code (IaC), and enterprise AI platform engineering to enable... ...lifecycle management and production AI systems. Experience designing cloud-...
- ...Job Summary A System Engineer specializing in the design, administration, and maintenance of IT infrastructure, servers, and operating systems. Responsible for ensuring system availability, performance optimization, security, and reliability. The role includes managing...
- ...carefully berore applying. Job Description – AI / ML Engineer | 0–12+ Years Experience... ...or PyTorch Generative AI & LLM Frameworks ~ HuggingFace or LangChain... ...leadership. Collaborate with enterprise architects, product owners, and business leaders....
- ...exciting challenges for our customers, at the intersection of AI/ML and cutting-edge cloud infrastructure, with NLP being a core area of what we do and what we... .../Answering or related fields ~ Experience in LLM reasoning, ACT, and ReACT methods ~ Experience in developing...
- ...Job Summary We are seeking Cloud Architect/Engineer professionals for our Riyadh office... ...using standard checklists and Infrastructure as Code modules, including Terraform.... ...Computer Science, Engineering, Information Systems, or a related discipline, or equivalent...
$6500 - $7000 per month
...regulations like GDPR. This role designs the technical infrastructure that supports data governance initiatives, from data modeling... ..., such as data catalogs and workflow management systems. Data quality and lineage: Establish and monitor data quality...- ...and method statements. Coordinate with multidisciplinary teams including Urban Planning, Landscape, Structural, MEP, BIM, and Infrastructure disciplines. Conduct site inspections to monitor construction quality, design compliance, and adherence to approved drawings...
Do you want to receive more vacancies?
Subscribe and receive similar vacancies to AI Systems Architect - LLM & Vector Infrastructure. Be the first to apply!

