Kforce has a client that is seeking a Senior Databricks Engineer in Armonk, NY. Summary: We are seeking a Senior Databricks Engineer to join our team and lead the architecture, setup, and optimization of Databricks environments for enterprise-scale data initiatives. This role will be critical in establishing secure and scalable Databricks platforms, integrating with diverse data sources, and enabling advanced analytics and AI/ML workloads. Responsibilities: * Architect, deploy, and configure Databricks workspaces in Azure environments * Establish secure and optimized connections to data sources (on-premise, cloud storage, relational and NoSQL databases, APIs, etc.) * Design and implement data pipelines using Databricks Delta Live Tables (DLT), Spark, and related technologies * Collaborate with security teams to ensure compliance with enterprise governance, authentication (IAM), and network policies (VPC, Private Link, etc.) * Optimize cluster configurations for cost, performance, and scalability based on workload patterns * Provide technical leadership and best practices guidance to data engineers and analysts on leveraging Databricks for data ingestion, transformation, and ML workflows * Troubleshoot and resolve performance, connectivity, and configuration issues within the Databricks platform * Develop automation scripts for provisioning and managing Databricks resources (Terraform, CI/CD pipelines, etc.)