Senior Databricks Developer Job in Australia 2026 | AI Talent

January 28, 2026 4:00 pm

Senior Databricks Developer Job in Australia 2026 | AI Talent

A prestigious opportunity is now available in Sydney, Australia, for an experienced Senior Databricks Developer to join a high-impact government health data transformation program. This role is offered through AI Talent in partnership with a leading public-sector organisation that is modernising its national analytics and research platforms using a secure, cloud-native architecture.

The position comes with Subclass 482 visa sponsorship, making it an excellent pathway for highly skilled international data engineers seeking long-term career growth and relocation to Australia. You will work on mission-critical data systems that directly support public health outcomes, policy development, and strategic resource planning at a national level.

About Role

As the Senior Databricks Developer, you will serve as the technical lead for advanced analytics and research workloads within a Databricks Lakehouse environment. Your core responsibility will be to architect, build, and optimise large-scale, production-grade data pipelines using PySpark and/or Scala.

You will take ownership of performance, reliability, data quality, and governance across complex datasets, including highly sensitive health information. This is a hands-on leadership role where you will work closely with analysts, data scientists, and other engineers to turn research models and analytical prototypes into robust, scalable, and compliant production systems, while also setting standards and mentoring team members.

About Hiring Firm

AI Talent is a respected specialist recruitment partner in the Australian technology market, known for connecting world-class professionals with high-impact organisations. For this role, they are working with a major government health sector institution responsible for large-scale data platforms that inform healthcare delivery, research, and policy decisions.

The organisation is deeply invested in modern data engineering practices, strong governance, and long-term platform sustainability, and has a strong history of supporting international professionals through structured relocation and 482 visa sponsorship programs.

Responsibilities

Lead the design and development of large-scale ETL/ELT pipelines using PySpark and/or Scala on Databricks
Architect and manage Delta Lake environments, including ingestion, data quality enforcement, and schema evolution
Optimise Databricks clusters, Spark jobs, and workloads for performance and cost efficiency
Define and enforce data governance, security, and access control using Unity Catalog and related tools
Collaborate with analysts and data scientists to productionise research and analytical models
Implement CI/CD and automation practices for Databricks notebooks and workflows
Support both batch and streaming data workloads at scale
Mentor junior engineers and promote best practices in modern data engineering and Spark optimisation

Requirements

Minimum of 6 years’ experience in data engineering, including 3+ years working with Databricks
Expert-level skills in PySpark and/or Scala for distributed data processing
Proven hands-on experience with Delta Lake, including DLT, time travel, and maintenance operations
Strong experience with cloud platforms, preferably Azure, and integration with cloud storage services
Advanced SQL knowledge and a solid understanding of data modelling principles
Experience with CI/CD, Infrastructure as Code, and automation tools such as Terraform
Strong communication and problem-solving skills, especially in regulated or compliance-driven environments

Click Here to Apply

Conclusion

This Senior Databricks Developer job in Australia with 482 visa sponsorship is a rare opportunity to combine advanced technical leadership with meaningful public-sector impact. For international professionals seeking a stable, high-profile, and future-focused role in Australia’s data and AI ecosystem, this position offers an exceptional platform for long-term career and relocation success.