Sr Data Engineer

We are seeking a highly skilled Databricks Engineer with
AI/ML experience <\/b> to design, build, and optimize scalable data and machine
learning platforms on Databricks. The role involves end -to -end ownership of
data pipelines, ML workflows, and production AI systems.
<\/p>

Key Responsibilities <\/b>
<\/p>

• Design
  and implement scalable ETL pipelines using Databricks & Spark
  <\/li>
• Build
  Lakehouse architecture using Delta Lake
  <\/li>
• Develop
  and deploy ML models using MLflow
  <\/li>
• Implement
  MLOps pipelines for training, testing, and serving models
  <\/li>
• Optimize
  cluster performance and reduce compute cost
  <\/li>
• Build
  RAG and LLM -based solutions using Mosaic AI
  <\/li>
• Integrate
  analytics with BI tools (Power BI, Tableau)
  <\/li>
• Implement
  data governance using Unity Catalog
  <\/li>
• Collaborate
  with Data Scientists and Business teams
  <\/li>
• Ensure
  data quality, security, and compliance
  <\/li><\/ul>

  Required Skills <\/b>
  <\/p>

  Mandatory <\/b>
  <\/p>

  • 5+
    years of Databricks & Apache Spark
    <\/li>
  • Strong
    Python & PySpark
    <\/li>
  • Experience
    with Delta Lake & Lakehouse
    <\/li>
  • MLflow
    & MLOps experience
    <\/li>
  • Cloud
    platform (AWS/Azure/GCP)
    <\/li>
  • Git
    & CI/CD
    <\/li><\/ul>

    Preferred <\/b>
    <\/p>

    • Experience
      with LLMs & Generative AI
      <\/li>
    • RAG
      pipelines & Vector Databases
      <\/li>
    • Deep
      Learning frameworks
      <\/li>
    • Databricks
      certifications
      <\/li>
    • Power
      BI integration
      <\/li><\/ul>

       
      <\/p>

      
      <\/div><\/span>
      

      Requirements <\/h3>

      Job Summary <\/b>
      <\/p>

      We are seeking a highly skilled Databricks Engineer with
      AI/ML experience <\/b> to design, build, and optimize scalable data and machine
      learning platforms on Databricks. The role involves end -to -end ownership of
      data pipelines, ML workflows, and production AI systems.
      <\/p>

      Key Responsibilities <\/b>
      <\/p>

      • Design
        and implement scalable ETL pipelines using Databricks & Spark
        <\/li>
      • Build
        Lakehouse architecture using Delta Lake
        <\/li>
      • Develop
        and deploy ML models using MLflow
        <\/li>
      • Implement
        MLOps pipelines for training, testing, and serving models
        <\/li>
      • Optimize
        cluster performance and reduce compute cost
        <\/li>
      • Build
        RAG and LLM -based solutions using Mosaic AI
        <\/li>
      • Integrate
        analytics with BI tools (Power BI, Tableau)
        <\/li>
      • Implement
        data governance using Unity Catalog
        <\/li>
      • Collaborate
        with Data Scientists and Business teams
        <\/li>
      • Ensure
        data quality, security, and compliance
        <\/li><\/ul>

        Required Skills <\/b>
        <\/p>

        Mandatory <\/b>
        <\/p>

        • 5+
          years of Databricks & Apache Spark
          <\/li>
        • Strong
          Python & PySpark
          <\/li>
        • Experience
          with Delta Lake & Lakehouse
          <\/li>
        • MLflow
          & MLOps experience
          <\/li>
        • Cloud
          platform (AWS/Azure/GCP)
          <\/li>
        • Git
          & CI/CD
          <\/li><\/ul>

          Preferred <\/b>
          <\/p>

          • Experience
            with LLMs & Generative AI
            <\/li>
          • RAG
            pipelines & Vector Databases
            <\/li>
          • Deep
            Learning frameworks
            <\/li>
          • Databricks
            certifications
            <\/li>
          • Power
            BI integration
            <\/li><\/ul>

             
            <\/p>

            
            <\/div><\/span>