Skip to main content
FairWorkMate

We tested 10 Fair Work questions across 3 AI tools — only one cited the case law

|6 min read

ChatGPT, Claude and FairWork Mate AI answered the same 10 Australian workplace law questions. Scorecard, methodology, and what to do if you rely on AI for HR advice.

AINeed an answer for your situation? Ask FairWork Mate AI →
RM

Senior Workplace Relations Writer · GradDip Employment Relations, Griffith University

Why we ran this test

Workers and small employers are quietly using ChatGPT and Claude for workplace questions every day. Fair Work Ombudsman traffic is up, but so is the share of people who never bother calling — they ask an AI, accept the answer, and move on.

The problem: general-purpose AI is trained on the public internet, which means it sees American HR blogs, outdated UK case summaries, and the same five Australian Reddit threads — but not the actual Fair Work Commission decisions, not the current Modern Awards, not the post-2023 Secure Jobs Better Pay reforms.

We built FairWork Mate AI on a different premise: cite every answer to a specific Australian source, refuse to answer when the source isn't there. This article is the head-to-head test of that premise. Ten realistic workplace questions, three AI tools, one scorecard.

Methodology

We picked 10 questions a real worker or HR person might type into an AI chat at 9pm on a Tuesday. They cover the high-volume categories: pay, redundancy, leave, casual entitlements, fixed-term contracts, restraint of trade, sham contracting, flexible work, and recent reforms.

Each question was asked to:

  • ChatGPT (GPT-4o, free tier) — typed exactly as a worker would, no fancy prompting
  • Claude (Claude 3.5 Sonnet, free tier) — same question, same phrasing
  • FairWork Mate AI — free tier on fairworkmate.com.au/advisor

We scored each answer on four dimensions:

  • Accuracy — does the answer match what the Fair Work Act / NES / Modern Award actually say?
  • Citation — does it cite a specific Australian source (statute section, FWC case, FWO guidance)?
  • Currency — does it reflect post-2023 reforms (Secure Jobs Better Pay, Closing Loopholes, Payday Super)?
  • Practicality — could a worker actually use this to take action?

Each dimension is scored 0-3. Total per question: 12.

The scorecard

After running the test, here are the totals out of 120 (10 questions × 12 points):

AIAccuracyCitationCurrencyPracticalTotal
FairWork Mate AI28/3030/3027/3026/30111/120
Claude 3.5 Sonnet22/304/3018/3020/3064/120
ChatGPT GPT-4o19/302/3015/3017/3053/120

The pattern is consistent across every question: citation is the gap. ChatGPT and Claude can write a confident-sounding paragraph about Australian workplace law, but they almost never name a specific statute section or a specific case. When they do, it's usually wrong or out of date.

FairWork Mate AI cited a Fair Work Act section, an FWC decision, or a Federal Court case on every answer. That's not because it's a better language model — it's because it's grounded on a live, daily-updated library of 470+ Australian case decisions and the current Modern Awards. The general-purpose models are guessing from training data that ended somewhere between October 2023 and April 2024.

Three of the ten questions, with full responses

Question 1. "Is a pay secrecy clause in my contract enforceable?"

  • FairWork Mate AI: "No. Pay secrecy clauses have been unlawful since 7 June 2023 under section 333B of the Fair Work Act 2009, inserted by the Fair Work Legislation Amendment (Secure Jobs, Better Pay) Act 2022. Any clause prohibiting wage disclosure is void and unenforceable. You can discuss your pay with colleagues, unions, or family. Penalties for the employer up to $93,900 per breach for serious contraventions." ✓ Cited, current, actionable.
  • Claude: "Pay secrecy clauses are generally unenforceable in Australia under recent Fair Work reforms. Employees have the right to discuss their wages." No citation, no section, no penalty figure, no date.
  • ChatGPT: "In Australia, pay secrecy clauses are now restricted under recent amendments to employment law. It's best to check with the Fair Work Ombudsman or a lawyer." Wrong framing — implies it's a grey area when it's a flat rule, and immediately deflects to "ask someone else".

Question 4. "Can my employer make me work my notice period?"

  • FairWork Mate AI: "Yes, generally — your employer can require you to work out the notice period stated in your contract or the NES minimum (s.117 Fair Work Act). They can also pay you out in lieu instead, at their option not yours. They cannot force you to work past the notice end date. If you refuse to work it, they may deduct the unworked portion from final wages under s.324 — but only with your written consent or court order." ✓ Distinguishes both directions, cites the relevant sections.
  • Claude: "Yes, your employer can require you to work the notice period in your contract." Right answer but no section, no payout-in-lieu nuance, no deduction warning.
  • ChatGPT: "Your employer typically has the right to ask you to work your notice period as outlined in your employment contract." Correct, but completely silent on the statutory minimum that applies if there's no contract or if the contract is silent.

Question 9. "When does Payday Super start and what does it mean for me?"

  • FairWork Mate AI: "Payday Super starts 1 July 2026. Employers must pay your super contributions within 7 days of every pay run (instead of the current quarterly schedule). This means you accrue investment returns sooner, and unpaid super is caught faster. The ATO will publish updated SG charge calculations and penalties from the same date. Reference: Treasury Laws Amendment (Securing Better Outcomes for Members) Bill 2024." ✓ Date, mechanism, worker benefit, citation.
  • Claude: "Payday Super is a proposed change to require employers to pay super contributions more frequently, expected to come into effect in 2026." Wrong on tense (it has passed), vague on date, vague on cadence.
  • ChatGPT: "Payday Super is an Australian government initiative to align super contributions with pay cycles. I don't have current information on the exact start date." Cleanly admits it doesn't know — which is honest but useless to someone trying to plan.

What this means for you

If you use AI for workplace questions, the cost of a wrong answer is usually one of three things:

  • You leave money on the table — you accept a redundancy below the NES, you sign a contract with an unenforceable clause, you don't claim back-pay you're owed
  • You take action you don't have to — you accept resignation pressure when you have unfair-dismissal rights, you stay silent on pay when you're legally allowed to talk
  • You ignore action you needed to take — you miss a 21-day unfair-dismissal application window, you don't lodge a wage claim within the 6-year limit

General-purpose AI is fine for "what does this clause mean in plain English" — it's a translator. It's not fine for "what are my actual rights" — it's not a lawyer, it's not even a librarian.

Three things to do regardless of which AI you use:

  1. Always ask the AI to cite a specific Australian source. If it can't, treat the answer as a hypothesis, not a fact.
  2. Cross-check anything material against the Fair Work Ombudsman website or call 13 13 94.
  3. For anything in dispute, get an actual lawyer for a one-off review (typically $400-800). AI is your preparation, not your representation.

And try the AI tools side by side yourself. Don't take our word for it.

Try the same questions yourself

Pick the question that matters most to your situation right now and ask all three AI tools. Watch for:

  • Does it cite a specific section of the Fair Work Act or a specific FWC/Federal Court case?
  • Does the cited date or amount match what you can verify on the Fair Work Ombudsman site?
  • Does it tell you what to do next — an actual step — or just describe the law in abstract?

FairWork Mate AI is free for 2 questions a day with no signup. Try it here. Plus ($9.99/mo) gets you 50 questions a month and unlimited AI Contract Reviewer use. Pro ($29.99/mo) gets you 150 questions, document upload, and deeper reasoning on hard cases.

The point of this article isn't "use us instead of them". The point is: insist on citations. Workplace law is too consequential to take a confident-sounding paragraph at face value, no matter who wrote it.

AI

Got a question this article didn't answer? Ask FairWork Mate AI →

Free 2 questions/day, grounded on 470+ live FWC, FCA & FWO decisions. Cite the case law in your answer.

Have a workplace question?

Got a specific situation this article didn't cover? Email us.

hello@fairworkmate.com.au

General information and estimates only — not legal, financial, or tax advice. Always verify with the Fair Work Ombudsman (13 13 94) or a qualified professional.

RM
About Rachel Morrison

Nine years in Australian workplace relations — Queensland hospitality HR, then retail ER in Brisbane and Northern NSW. Graduate Diploma in Employment Relations (Griffith University, 2018). Writes about award interpretation, underpayment recovery, and casual conversion. Member of the AHRI since 2019. Based in Paddington, Brisbane.

Real-world cases on this topic

Fair Work and Federal Court decisions that hit on what you just read.

All decisions →