<?xml version="1.0" encoding="utf-8" standalone="yes"?>
<rss version="2.0" xmlns:atom="http://www.w3.org/2005/Atom">
  <channel>
    <title>Gemma on 67AI Lab</title>
    <link>https://67ailab.com/tags/gemma/</link>
    <description>Recent content in Gemma on 67AI Lab</description>
    <generator>Hugo</generator>
    <language>en-us</language>
    <lastBuildDate>Thu, 12 Nov 2026 14:50:00 +0000</lastBuildDate>
    <atom:link href="https://67ailab.com/tags/gemma/index.xml" rel="self" type="application/rss+xml" />
    <item>
      <title>Which Jobs Can a Small Local Model Take Over? Results from Eight Real Tasks</title>
      <link>https://67ailab.com/posts/spark-eval-01-overall-results/</link>
      <pubDate>Thu, 12 Nov 2026 14:50:00 +0000</pubDate>
      <guid>https://67ailab.com/posts/spark-eval-01-overall-results/</guid>
      <description>&lt;p&gt;Most teams that use a frontier model through an API are paying frontier&#xA;prices for work that isn&amp;rsquo;t frontier work: sorting, extracting, filling in&#xA;forms, following a script. The obvious question is how much of that a small&#xA;open model could do instead.&lt;/p&gt;&#xA;&lt;p&gt;The usual answers don&amp;rsquo;t help much. Leaderboards measure someone else&amp;rsquo;s tasks,&#xA;and a model that is &amp;ldquo;within a few points on average&amp;rdquo; can still fail in&#xA;exactly the way that hurts you. So we measured it on &lt;strong&gt;eight narrow,&#xA;realistic tasks&lt;/strong&gt;, with a pass rule written down for each one before any&#xA;model ran.&lt;/p&gt;</description>
    </item>
  </channel>
</rss>
