AI and Automation Specialist Job in Australia 2026 | AI Talent

January 28, 2026 4:49 am

AI and Automation Specialist Job in Australia 2026 | AI Talent

An exceptional opportunity is now available in Australia for an experienced AI and Automation Specialist / Senior Databricks Developer to join a high-impact government health data program in Sydney. This role is offered through AI Talent in partnership with a major public-sector organisation modernising its national health analytics and research platforms.

The position is eligible for Subclass 482 (Temporary Skill Shortage) visa sponsorship, making it ideal for highly skilled international professionals seeking a long-term, career-defining role in Australia. You will work at the intersection of cloud, big data, and advanced analytics, helping to build secure, scalable, and mission-critical data platforms that directly support public health outcomes and policy decisions.

About Role

In this senior technical role, you will act as a platform and data engineering leader within a Databricks Lakehouse environment. Your primary mission will be to design, build, and optimise large-scale data pipelines using PySpark and/or Scala, ensuring performance, reliability, and strict governance for sensitive health datasets.

You will work closely with analysts, researchers, and data scientists to productionise analytical workloads and research models, while also setting engineering standards, improving automation, and mentoring other engineers. This is a hands-on, high-responsibility role in a highly regulated environment where quality, security, and scalability are critical.

About Hiring Firm

AI Talent is a specialist technology recruitment partner working with leading public and private sector organisations across Australia. For this role, they are partnering with a key government health sector organisation responsible for large-scale data platforms that support healthcare planning, research, and policy.

The organisation is committed to modern, cloud-native architecture, strong data governance, and long-term investment in advanced analytics capabilities. They have a proven track record of supporting international professionals through structured relocation and visa sponsorship under the Subclass 482 program.

Responsibilities

Lead the design and development of scalable ETL/ELT pipelines using PySpark and/or Scala on Databricks
Architect and manage Delta Lake environments, including data ingestion, quality controls, and schema evolution
Optimise Spark jobs, Databricks clusters, and workloads for performance and cost efficiency
Define and enforce data governance and access control using Unity Catalog and related tools
Collaborate with analysts and data scientists to productionise analytical and research workflows
Implement CI/CD and automation practices for Databricks notebooks and data pipelines
Support streaming and batch workloads handling large, complex public health datasets
Mentor junior engineers and promote best practices in modern data engineering

Requirements

At least 6 years of experience in data engineering, including 3+ years on the Databricks platform
Expert proficiency in PySpark and/or Scala for distributed data processing
Proven hands-on experience with Delta Lake, including DLT, time travel, and maintenance operations
Strong experience with cloud platforms, preferably Azure, and integration with cloud storage services
Advanced SQL skills and a solid understanding of data modelling principles
Experience with CI/CD, Infrastructure as Code, and automation tools such as Terraform
Strong communication skills and experience working in regulated or compliance-driven environments

Click Here to Apply

Conclusion

This AI and Automation Specialist job in Australia with 482 visa sponsorship offers a rare chance to combine advanced technical work with real-world public impact. For international candidates seeking a prestigious, stable, and future-focused role in Australia’s data and AI ecosystem, this is an outstanding opportunity to build long-term career value while contributing to a nationally important mission.