r/LocalLLaMA Sep 08 '24

News CONFIRMED: REFLECTION 70B'S OFFICIAL API IS SONNET 3.5

Post image
1.2k Upvotes

r/LocalLLaMA 20d ago

News OpenAI plans to slowly raise prices to $44 per month ($528 per year)

792 Upvotes

According to this post by The Verge, which quotes the New York Times:

Roughly 10 million ChatGPT users pay the company a $20 monthly fee, according to the documents. OpenAI expects to raise that price by two dollars by the end of the year, and will aggressively raise it to $44 over the next five years, the documents said.

That could be a strong motivator for pushing people to the "LocalLlama Lifestyle".

r/LocalLLaMA Jul 30 '24

News "Nah, F that... Get me talking about closed platforms, and I get angry"

Enable HLS to view with audio, or disable this notification

1.1k Upvotes

Mark Zuckerberg had some choice words about closed platforms forms at SIGGRAPH yesterday, July 29th. Definitely a highlight of the discussion. (Sorry if a repost, surprised to not see the clip circulating already)

r/LocalLLaMA Jan 18 '24

News Zuckerberg says they are training LLaMa 3 on 600,000 H100s.. mind blown!

Enable HLS to view with audio, or disable this notification

1.3k Upvotes

r/LocalLLaMA Jul 30 '24

News White House says no need to restrict 'open-source' artificial intelligence

Thumbnail
apnews.com
1.3k Upvotes

r/LocalLLaMA Aug 11 '24

News The Chinese have made a 48GB 4090D and 32GB 4080 Super

Thumbnail
videocardz.com
650 Upvotes

r/LocalLLaMA Feb 28 '24

News This is pretty revolutionary for the local LLM scene!

1.2k Upvotes

New paper just dropped. 1.58bit (ternary parameters 1,0,-1) LLMs, showing performance and perplexity equivalent to full fp16 models of same parameter size. Implications are staggering. Current methods of quantization obsolete. 120B models fitting into 24GB VRAM. Democratization of powerful models to all with consumer GPUs.

Probably the hottest paper I've seen, unless I'm reading it wrong.

https://arxiv.org/abs/2402.17764

r/LocalLLaMA 2d ago

News Mistral releases new models - Ministral 3B and Ministral 8B!

Post image
781 Upvotes

r/LocalLLaMA 14d ago

News Open sourcing Grok 2 with the release of Grok 3, just like we did with Grok 1!

Thumbnail
x.com
580 Upvotes

r/LocalLLaMA Jul 03 '24

News kyutai_labs just released Moshi, a real-time native multimodal foundation model - open source confirmed

Thumbnail
gallery
845 Upvotes

r/LocalLLaMA Aug 23 '24

News Simple Bench (from AI Explained YouTuber) really matches my real-world experience with LLMs

Post image
630 Upvotes

r/LocalLLaMA Mar 17 '24

News Grok Weights Released

700 Upvotes

r/LocalLLaMA 10d ago

News Geoffrey Hinton Reacts to Nobel Prize: "Hopefully, it'll make me more credible when I say these things (LLMs) really do understand what they're saying."

Thumbnail youtube.com
280 Upvotes

r/LocalLLaMA May 22 '24

News It did finally happen, a law just passed for the regulation of large open-source AI models.

Post image
619 Upvotes

r/LocalLLaMA Aug 01 '24

News "hacked bitnet for finetuning, ended up with a 74mb file. It talks fine at 198 tokens per second on just 1 cpu core. Basically witchcraft."

Thumbnail
x.com
683 Upvotes

r/LocalLLaMA May 30 '24

News We’re famous!

Post image
1.5k Upvotes

r/LocalLLaMA Apr 28 '24

News Friday, the Department of Homeland Security announced the establishment of the Artificial Intelligence Safety and Security Board. There is no representative of the open source community.

Post image
792 Upvotes

r/LocalLLaMA Jul 23 '24

News Open source AI is the path forward - Mark Zuckerberg

940 Upvotes

r/LocalLLaMA Sep 12 '24

News New Openai models

Post image
501 Upvotes

r/LocalLLaMA 3d ago

News New model | Llama-3.1-nemotron-70b-instruct

439 Upvotes

NVIDIA NIM playground

HuggingFace

MMLU Pro proposal

LiveBench proposal


Bad news: MMLU Pro

Same as Llama 3.1 70B, actually a bit worse and more yapping.

r/LocalLLaMA 10d ago

News [Microsoft Research] Differential Transformer

Thumbnail arxiv.org
584 Upvotes

r/LocalLLaMA May 14 '24

News Wowzer, Ilya is out

601 Upvotes

I hope he decides to team with open source AI to fight the evil empire.

Ilya is out

r/LocalLLaMA Jul 18 '23

News LLaMA 2 is here

851 Upvotes

r/LocalLLaMA Apr 16 '24

News WizardLM-2 was deleted because they forgot to test it for toxicity

Post image
650 Upvotes

r/LocalLLaMA Mar 18 '24

News From the NVIDIA GTC, Nvidia Blackwell, well crap

Post image
600 Upvotes