{"id":657,"date":"2025-09-22T20:01:20","date_gmt":"2025-09-22T20:01:20","guid":{"rendered":"https:\/\/millermattson.com\/dave\/?p=657"},"modified":"2025-09-22T20:01:20","modified_gmt":"2025-09-22T20:01:20","slug":"llm-speech-writing-contest","status":"publish","type":"post","link":"https:\/\/millermattson.com\/dave\/?p=657","title":{"rendered":"LLM Speech Writing Contest"},"content":{"rendered":"\n<h2 class=\"wp-block-heading\">Abstract<\/h2>\n\n\n\n<p>Just for fun, I tested several LLMs for their rhetorical skills by asking them to write a speech, then using two LLMs to judge the results. As expected, the closed commercial models scored highest, but the open-weight gpt-oss 20B model scored surprisingly well. The final results are shown in Figure 1. The LLMs shown in green in the chart are open-weight models that I ran locally on consumer hardware. The bars show the low, high and average scores for each model.<\/p>\n\n\n\n<p><a href=\"https:\/\/millermattson.com\/dave\/wp-content\/uploads\/2025\/09\/LLM-speeches-v2.pdf\">Click here to see the full PDF report.<\/a><\/p>\n\n\n\n<p><\/p>\n","protected":false},"excerpt":{"rendered":"<p>Abstract Just for fun, I tested several LLMs for their rhetorical skills by asking them to write a speech, then using two LLMs to judge the results. As expected, the closed commercial models scored highest, but the open-weight gpt-oss 20B model scored surprisingly well. The final results are shown in Figure 1. The LLMs shown [&hellip;]<\/p>\n","protected":false},"author":2,"featured_media":656,"comment_status":"open","ping_status":"closed","sticky":false,"template":"","format":"standard","meta":{"footnotes":""},"categories":[83,110],"tags":[86,104,109],"class_list":["post-657","post","type-post","status-publish","format-standard","has-post-thumbnail","hentry","category-ai","category-writing","tag-ai","tag-llm","tag-writing"],"_links":{"self":[{"href":"https:\/\/millermattson.com\/dave\/index.php?rest_route=\/wp\/v2\/posts\/657","targetHints":{"allow":["GET"]}}],"collection":[{"href":"https:\/\/millermattson.com\/dave\/index.php?rest_route=\/wp\/v2\/posts"}],"about":[{"href":"https:\/\/millermattson.com\/dave\/index.php?rest_route=\/wp\/v2\/types\/post"}],"author":[{"embeddable":true,"href":"https:\/\/millermattson.com\/dave\/index.php?rest_route=\/wp\/v2\/users\/2"}],"replies":[{"embeddable":true,"href":"https:\/\/millermattson.com\/dave\/index.php?rest_route=%2Fwp%2Fv2%2Fcomments&post=657"}],"version-history":[{"count":1,"href":"https:\/\/millermattson.com\/dave\/index.php?rest_route=\/wp\/v2\/posts\/657\/revisions"}],"predecessor-version":[{"id":658,"href":"https:\/\/millermattson.com\/dave\/index.php?rest_route=\/wp\/v2\/posts\/657\/revisions\/658"}],"wp:featuredmedia":[{"embeddable":true,"href":"https:\/\/millermattson.com\/dave\/index.php?rest_route=\/wp\/v2\/media\/656"}],"wp:attachment":[{"href":"https:\/\/millermattson.com\/dave\/index.php?rest_route=%2Fwp%2Fv2%2Fmedia&parent=657"}],"wp:term":[{"taxonomy":"category","embeddable":true,"href":"https:\/\/millermattson.com\/dave\/index.php?rest_route=%2Fwp%2Fv2%2Fcategories&post=657"},{"taxonomy":"post_tag","embeddable":true,"href":"https:\/\/millermattson.com\/dave\/index.php?rest_route=%2Fwp%2Fv2%2Ftags&post=657"}],"curies":[{"name":"wp","href":"https:\/\/api.w.org\/{rel}","templated":true}]}}