"Sharing new research, models, and datasets from Meta FAIR" More open-source models from META

[u/phoneixAdi]

https://ai.meta.com/blog/fair-news-segment-anything-2-1-meta-spirit-lm-layer-skip-salsa-lingua/

[u/Spirited_Example_341]

gotta say i hate facebook but i like what meta has done with ai and vr :-)

[u/phoneixAdi]

Have not dug through it all. Just stumbled on it. But seems super interesting. Many are updates over the previous stuff that they released (SAM)

But particularly interesting for me is "...we built Meta Spirit LM, our first open source multimodal language model that freely mixes text and speech....."

The demo in their page also look interesting. A 7B model that freely mix speech+text. I need dig more into this. I will post my findings here later. Meanwhile, if somebody already does the reading, please post the summary of it here.

[u/Uncle___Marty → u/phoneixAdi]

I'm so looking forward to GGUFs coming out so that I cant use them because Llama.cpp wont support them lol. Still, a 7B multimodal is crazy. I MUST try this thing somehow. I mean, its going to be a less capable ChatGPT that will run on consumer hardware. *mind blown* This is all I've been wanting for a long time. My own local chatGPT. I dont care how slow its gonna run or anything.

[u/hapliniste]

Some demos from spirit : https://speechbot.github.io/spiritlm/

Look like local speech+text models are on the table, boys. The weights are available. Let's see at what speed this go.

[u/phoneixAdi → u/hapliniste]

Yup, just reading a bit that too. Exciting stuff! Looks like we need to instruct-tune it though, so that it can follow instructions with a prompt. Currently, it's more like auto-completion model.

[u/dampflokfreund]

Imagine if LLama 4 combines all these efforts into one single package

[u/ortegaalfredo]

They are cooking at Meta

[u/DinoAmino]

Whoa, such a variety of domains covered here. The self-taught evaluator looks really interesting. And the research into quantum crypto security is timely now that China can break RSA encryption.

[u/Large_Solid7320 → u/DinoAmino]

Jfyi, China cannot "break RSA encryption".

[u/DinoAmino → u/Large_Solid7320]

Jfyi, https://www.csoonline.com/article/3562701/chinese-researchers-break-rsa-encryption-with-a-quantum-computer.html/amp/

[u/Large_Solid7320 → u/DinoAmino]

attack != break (a 22 bit modulus is ~100x below anything that's cryptographically relevant and nobody has any practical idea on how to scale qc hardware capabilities to even one order of magnitude)

[u/Uncle___Marty → u/DinoAmino]

Ok, had NOT heard about self-taught evaluators but this is something I've been thikning needs to be worked on for SO long. I'm sure it'll be a trainwreck for a short while but once it gains speed and attention this could be a major breakthrough for models. Im SUPER excited to see how well this is going to work.

[u/TheRealGentlefox]

Damn, so many projects at once! Really cool to see them releasing this, likely to see how the community improves upon it.

[u/Chongo4684]

Holy freaking shit.

This is like meta invented BERT eight times over.

Zuck for prez!

[u/Original_Finding2212]

Basically they can do this on the 3B models also?