Home » Australia’s Large Language Model Landscape: Technical Assessment

Australia’s Large Language Model Landscape: Technical Assessment

Key Points

  • No flagship, globally competitive, locally developed LLM (such as GPT-4, Claude 3.5, LLaMA 3.1) has yet emerged from Australia. Australian research and commerce currently rely primarily on international LLMs, which are frequently used but have measurable limitations on Australian English and cultural context.
  • Kangaroo LLM is the only major open-source, locally developed LLM project. Backed by a consortium of Katonic AI, RackCorp, NEXTDC, Hitachi Vantara, and Hewlett Packard Enterprise, it aims to build a model specifically for Australian English, but remains in early data collection and governance phases, with no published model weights, benchmarks, or production deployment as of August 2025.l
  • International models (Claude 3.5 Sonnet, GPT-4, LLaMA 2) are widely accessible in Australia and used in research, government, and industry. Their deployment in Australian contexts is often subject to data sovereignty, privacy law, and model fine-tuning challenges.
  • Australian academic research makes important contributions to LLM evaluation, fairness, and domain adaptation—not foundational architecture. Work at UNSW, Macquarie, and the University of Adelaide focuses on bias detection, medical and legal applications, and fine-tuning of pre-trained models, not on building new, large-scale LLMs from scratch.
  • Government and industry investment in AI is growing, but AI sovereignty remains aspirational. There is active policy development, increased venture capital, and strategic university-industry partnerships, but no national computational infrastructure or commercial ecosystem for training large, general-purpose LLMs at scale.

Local Model Development: Kangaroo LLM

Kangaroo LLM is Australia’s flagship effort to build a sovereign, open-source large language model tailored to Australian English and culture. The project is managed by a nonprofit consortium and aims to create a model that understands Australian humor, slang, and legal/ethical norms. However, as of August 2025, Kangaroo LLM is not yet a fully trained, benchmarked, or publicly available model. Its current status is best described as follows:

  • Partners: Katonic AI (lead), RackCorp, NEXTDC, Hitachi Vantara, Hewlett Packard Enterprise.
  • Mission: To create an open-source LLM trained on Australian web content, with data sovereignty and local cultural alignment as primary goals.
  • Progress: The project has identified 4.2 million Australian websites for potential data collection, with an initial focus on 754,000 sites. Crawling was delayed in late 2024 due to legal and privacy concerns, and no public dataset or model has been released.
  • Technical Approach: The “Kangaroo Bot” crawler respects robots.txt and allows opt-out for websites. Data is processed into the “VegeMighty Dataset” and refined through a “Great Barrier Reef Pipeline” for LLM training. The model’s architecture, size, and training methodology remain undisclosed.
  • Governance: Operates as a nonprofit with volunteer labor (about 100 volunteers, 10+ full-time equivalent). Funding is sought from corporate clients and possible government grants, but no major public or private investment has been announced.
  • Timeline: Originally slated for an October 2024 launch, but as of August 2025, the project is still in the data collection and legal compliance phase, with no confirmed release date for a trained model.
  • Significance: Kangaroo LLM is a symbolic and practical step toward AI sovereignty, but it does not yet represent a technical alternative to global LLMs. Success will depend on sustained funding, technical execution, and adoption by Australian developers and enterprises.

International Model Deployment

Claude 3.5 Sonnet (Anthropic), GPT-4 (OpenAI), and LLaMA 2 (Meta) are all available and actively used in Australian research and industry. Their adoption is driven by their superior capabilities, ease of access via cloud providers (AWS, Azure, Google Cloud), and integration into enterprise workflows.

  • Claude 3.5 Sonnet has been available in AWS’s Sydney region since February 2025, enabling Australian organizations to use a state-of-the-art LLM with data residency compliance. This model is used in applications ranging from customer service to scientific research.
  • GPT-4 and LLaMA 2 are widely used in Australian universities, startups, and corporations for prototyping, content generation, and task automation. Their use is often accompanied by fine-tuning on local datasets to improve relevance and accuracy.
  • University of Sydney Case Study: A team used Claude to analyze whale acoustic data, achieving 89.4% accuracy in detecting minke whales—a significant improvement over traditional methods (76.5%). This project demonstrates how global LLMs can be adapted for local scientific needs, but also highlights Australia’s reliance on external model providers.

Research Contributions

Australia’s academic institutions are active in LLM research, but their focus is on evaluation, fairness, domain adaptation, and application—not on building new, large-scale foundational models.

  • UNSW’s BESSTIE Benchmark: A systematic evaluation framework for sentiment and sarcasm in Australian, British, and Indian English. It reveals that global LLMs consistently underperform on Australian English, especially for sarcasm detection (F-score 0.59 on Reddit, compared to 0.81 for sentiment). This work is critical for understanding the limitations of current models in local contexts.
  • Macquarie University’s Biomedical LLMs: Researchers have fine-tuned BERT variants (BioBERT, ALBERT) for medical question answering, achieving top scores in international competitions. This demonstrates Australia’s strength in adapting existing models to specialized domains, but not in developing new architectures.
  • CSIRO Data61: Publishes influential research on agent-based systems using LLMs, privacy-preserving AI, and model risk management. Their work is practical and policy-focused, not focused on foundational model development.
  • University of Adelaide and CommBank Partnership: The CommBank Centre for Foundational AI, established in late 2024, aims to advance machine learning for financial services, including fraud detection and personalized banking. This is a significant industry investment, but again, the focus is on application and fine-tuning, not on building a new, large-scale LLM.

Policy, Investment, and Ecosystem

Government Policy:
The Australian government has developed a risk-based AI policy framework, with mandatory transparency, testing, and accountability for high-risk applications. Privacy law reforms in 2024 introduced new requirements for AI transparency, affecting how models are selected and deployed.

Investment:
Venture capital in Australian AI startups reached AUD$1.3 billion in 2024, with AI accounting for nearly 30% of all venture deals in early 2025. However, most of this investment is in application-layer companies, not in foundational model development.

Industry Adoption:
A 2024 survey found that 71% of Australian university staff use generative AI tools, primarily ChatGPT and Claude. Enterprise adoption is growing, but often limited by data sovereignty requirements, privacy compliance, and the lack of locally tailored models.

Computational Infrastructure:
Australia does not have large-scale, sovereign computational infrastructure for LLM training. Most large-scale model training and inference rely on international cloud providers, though AWS’s Sydney region now supports Claude 3.5 Sonnet at scale.

Summary

Australia’s LLM landscape is defined by strong application-driven research, growing enterprise adoption, and active policy development, but no sovereign, large-scale foundational model. Kangaroo LLM is one of the few significant local effort, but it remains in early stages and faces major technical and resourcing hurdles.

In summary, Australia is a sophisticated user and adapter of LLMs, but not yet a builder of them. The most important elements are clear: Kangaroo LLM is a meaningful step, but not yet a solution; global models dominate but have local limitations; and Australian research and policy are world-class in evaluation and application, not in foundational innovation.


Sources:

  1. https://kangaroollm.com.au
  2. https://au.linkedin.com/company/kangaroo-llm
  3. https://ia.acs.org.au/article/2024/australian-ai-project-calls-for-more-unpaid-volunteers.html
  4. https://www.aboutamazon.com.au/news/aws/the-upgraded-claude-3-5-sonnet-anthropics-most-intelligent-ai-model-to-date-now-available-in-aws-sydney-region
  5. https://www.anthropic.com/customers/university-of-sydney
  6. https://www.sydney.edu.au/news-opinion/news/2025/06/05/whale-song-crunched-for-minke-conservation1.html
  7. https://aclanthology.org/2025.findings-acl.441.pdf
  8. https://aclanthology.org/2023.bsnlp-1.7.pdf
  9. https://ceur-ws.org/Vol-2936/paper-20.pdf
  10. https://www.adelaide.edu.au/aiml/news/list/2024/09/20/aiml-and-commbank-join-forces-to-establish-new-centre-for-foundational
  11. https://www.commbank.com.au/articles/newsroom/2025/03/anthropic.html
  12. https://www.csiro.au/en/research/technology-space/ai/nsf-ai-research
  13. https://investmentcouncil.com.au/Common/Uploaded%20files/Smart%20Suite/Smart%20Library/ccd30dea-7be2-45e6-974c-bf98336c879f/2025%20Australian%20Private%20Capital%20Yearbook.pdf
  14. https://www.bestbrokers.com/forex-brokers/the-state-of-ai-venture-capital-in-2025-ai-boom-slows-with-fewer-startups-but-bigger-bets/
  15. https://www.cutthrough.com/insights/cut-through-quarterly-1q-2025
  16. https://ia.acs.org.au/article/2025/what-deepseeks-rise-could-mean-for-australian-ai.html
  17. https://www.digital.gov.au/policy/ai/policy
  18. https://spruson.com/privacy-and-ai-regulations-2024-review-2025-outlook/
  19. https://kangaroollm.com.au
  20. https://kangaroollm.com.au/kangaroo-bot/
  21. https://au.linkedin.com/company/kangaroo-llm
  22. https://ia.acs.org.au/article/2024/australian-ai-project-calls-for-more-unpaid-volunteers.html
  23. https://ia.acs.org.au/article/2025/what-deepseeks-rise-could-mean-for-australian-ai.html
  24. https://www.linkedin.com/posts/kangaroo-llm_australiandomains-digitalpresence-techtrends-activity-7241954718191652865-W1Fw
  25. https://www.myaustraliannews.com.au/news-releases.html?id=1012302&headline=kangaroo-llm-launches-massive-web-crawl-to-build-australias-first-open-source-ai-model&pageNumber=7
  26. https://www.forbes.com/councils/forbestechcouncil/2024/10/31/why-its-high-time-for-australia-to-build-its-own-large-language-model/
  27. https://www.kangaroostudies.com


Michal Sutter is a data science professional with a Master of Science in Data Science from the University of Padova. With a solid foundation in statistical analysis, machine learning, and data engineering, Michal excels at transforming complex datasets into actionable insights.

Related Posts

Leave a Reply

Your email address will not be published. Required fields are marked *