AI Data Enablement Engineer

Our Client's Digital Finance IT is building an AI-enablement layer on top of our enterprise data platform to enable business users across Finance to interact with governed data in natural language. We're hiring a Data Enablement Engineer to design, build, and operate the trusted datasets, semantic models, and embedded AI experiences that make this possible. This is a data platform engineering role, not a data science or model-building role. You will spend your time engineering the data foundation that makes AI reliable — semantic layers, governed data products, and embedded natural-language analytics — not training models.

What You'll Do

• Design and build AI-ready data products on Databricks — trusted datasets with well-defined business semantics, KPIs, hierarchies, and business glossary alignment

• Implement semantic layers and governed datasets that support both traditional BI consumption and natural-language querying by business users

• Deploy and operate Databricks Genie spaces with Unity Catalog, tuning them for accuracy, adoption, and business relevance

• Build RAG pipelines and conversational analytics applications grounded in governed enterprise data — including Streamlit or Databricks Apps that let business users query data without writing SQL

• Engineer robust ETL/ELT pipelines (dbt, Airflow, PySpark) that produce and maintain the trusted data these AI experiences depend on

• Implement data governance — RBAC, row/column-level security, masking, lineage, auditability, catalog and metadata management — in a regulated pharma environment

• Optimize cost and performance on both the data platform side (warehouse sizing, cluster tuning, query optimization) and the AI side (token usage, caching, model routing)

• Partner with Finance business stakeholders to translate domain requirements into semantic models and governed data products they can trust

Requirements

Must-Have Experience

• 5+ years hands-on data engineering on cloud data platforms — Databricks demonstrated in real project delivery, not skill-list-only

• Direct hands-on experience with Databricks Genie — you have built, configured, and tuned these in production or advanced pilots, with specific reference to the flavors used (Genie spaces with semantic models)

• Semantic layer / trusted data product delivery — you have built governed datasets that business users can rely on, with KPI definitions, hierarchies, and business glossary alignment

• dbt, PySpark, SQL, Python — strong across the modern data stack

• Orchestration with Airflow, Databricks Workflows, or equivalent

• Data governance in regulated environments — RBAC, RLS, masking, lineage, auditability

• Experience integrating structured and unstructured data (PDFs, SharePoint/Teams content, enterprise knowledge sources) into AI-enablement workflows

Nice to Have

• Pharma, life sciences, or regulated financial services domain experience

• Veeva CRM, IQVIA, SAP, or clinical data source integration

• Streamlit or Databricks Apps for business-facing analytics

• Databricks Data Engineer Professional certification

• LangChain, LlamaIndex, or equivalent RAG frameworks

• Cost optimization on both compute (warehouse/cluster) and LLM (tokens/caching/routing) dimensions

What We're NOT Looking For

• Data Scientists — this role is not model training, fine-tuning, LoRA/RLHF, or ML research

• Pure Data Engineers who list Cortex or Genie as a skill but haven't shipped it in production

• AI/GenAI engineers whose center of gravity is LangChain agents or RAG-over-documents, without a strong governed data platform foundation

• Computer vision, NLP model builders, or multi-agent orchestration specialists — wrong shape for this role