sfba.social is one of the many independent Mastodon servers you can use to participate in the fediverse.
A Mastodon instance for the San Francisco Bay Area. Come on in and join us!

Server stats:

2.4K
active users

William Pietri

We've launched! After months of work, MLCommons has released our v1.0 benchmark that measures LLM (aka "AI") propensity for giving hazardous responses.

Here's the results for 15 common models: ailuminate.mlcommons.org/bench

And here's the overview: mlcommons.org/ailuminate/

I was the tech lead for the software and want to give a shout out to my excellent team of developers and the many experts we worked closely with to make this happen.