-
Has AI Passed or Aced Law Exams?
John Bliss 1/3/24. At various points in the past year, it has been widely reported that generative AI systems have aced the bar exam at the 90th percentile, floundered on law school exams, and failed to show utility in real-world legal tasks. Yet, the latest empirical findings push back against each of these claims, highlighting the importance of updating our views as the technology advances and new research findings are released. The Bar Exam When researchers found that GPT-4 passed…
-
Why e-SAIL? The Importance of Keeping up with the Research
John Bliss 12/30/23. Legal AI is a fast moving field. In just the past year, we saw OpenAI’s foundation models improve from failing the Unified Bar Exam (miserably, with GPT-3.5 scoring below the 1st percentile) to passing it (comfortably, with GPT-4 scoring at roughly the 62nd percentile among first-time takers).[1] We have seen similar jumps on law school exams, from GPT-3.5 barely passing to GPT-4 reaching the A- to A range with the best-performing prompts.[2] This technology is now being…
-
Subscribe
Subscribed
Already have a WordPress.com account? Log in now.
Empirical Studies of AI Lawyering (e-SAIL) 