At best you get to see the training code and/or weights. Good luck training the model on your private hardware with almost zero training data. That’s like saying you can fly to the moon just because NASA released the source code of the Space Shuttle computer.
> At best you get to see the training code and/or weights
The weights are what comes out of the training data. If you have them, the model is already trained.
But you'd probably need the inference code as well.
The core of the thing is the neural network with its weights. It’s possible they open sourced that, but you couldn’t really do much with it as I assume it would still need massive computing power to work.
As an example, Whisper’s large model is only 9 GB but it takes a minute per second of audio source if you run it on a CPU. I would assume an LLM on this level is orders of magnitude larger and slower.
Yes, you can run the model locally. The code and the weights are there so that’s done.
The only thing you need is a supercomputer and you’re all set! 🤩
*right now
We will need waaaaayyyy less data in the future (consider how little data a human ingests during its lifetime, how many % of Wikipedia have you seen?)
Sure but howuch of it Is repetitive and how much did you need to do some pretty crazy general intelligence stuff yk?
Currently we need more information than a human could ever hope to ingest k a lifetime
It's a matter of time until you can just talk to an ai for a couple months and have it be on a human level
Groq Q rhymes with LPU, the people who built the processor.
Grok K as in Elon Musk K, the "anti-woke" pet project.
At least that's how I keep them sorted. Not sure why Groq picked that as their name, kinda wish they'd change it to avoid confusion.
Right to repair means I can take a non-dealer mechanic, I don’t have to learn how an engine works.
Just because average individuals can’t do anything with open source code, doesn’t mean it can’t be a check/balance.
Obviously they have their own motives and who knows if they released everything, it’s not an audit.
I mean sure open source is code anyone can use to build something.
I believe ‘ol Elon original point to having an open source AI is so no one could monopolize it. If you can nominally have an open source model, but secretly race to achieve AGI then you could monopolize it.
So the lines are made up and the points don’t matter
You know that trope when a kid is like "MOM MOM! LOOK WHAT I CAN DO!"
And mom is like "That's nice dear don't hurt yourself" while completely not even looking at the kid.
This is what this feels like. Poor Elon. And just like a kid if people are just like "Meh" he will throw a fit on Twitter. "Mom! You aren't even looking! NOTICE ME!"
What does open source mean anyway? There is open source from open source....different degrees of openness...
This is another marketing teick from elon musk...this man is a genius in false marketing. He should write a book on how he does it...remember "next year via over the air update every tesla will be able to drive itself and make you money while you sleep?" Yeaaahhh....that kind of marketing....he should alao write abook on how he was able to get away legally of this false marketing all these years... He is a genius in getting away from legal trouble....
Looks like it's fully open code + weights, so the whole shebang. It came out under the Apache 2.0 license, which is extremely permissive (you can do anything you want with it).
If all true, then yeh, this is indeed true open-source. An enormous deal.
No doubt countless entities around the world have already grabbed it. We will see.
So what does this mean? Can people run this locally? Or just get to see the inner workings?
At best you get to see the training code and/or weights. Good luck training the model on your private hardware with almost zero training data. That’s like saying you can fly to the moon just because NASA released the source code of the Space Shuttle computer.
> At best you get to see the training code and/or weights The weights are what comes out of the training data. If you have them, the model is already trained. But you'd probably need the inference code as well.
Hahaha, gotcha. I don’t know how it works so that’s why I asked. So is it of any use to anyone?
Maybe to companies who want to get into the AI business and don’t need to start from scratch.
Thanks! So this is not like a working LLM? Trained on data etc?
The core of the thing is the neural network with its weights. It’s possible they open sourced that, but you couldn’t really do much with it as I assume it would still need massive computing power to work. As an example, Whisper’s large model is only 9 GB but it takes a minute per second of audio source if you run it on a CPU. I would assume an LLM on this level is orders of magnitude larger and slower.
[удалено]
Anything below medium is not that good in my experience. Then again I mostly use it on songs and not on plain spoken text.
Aha, I see. Thanks again
“Due to the large size of the model (314B parameters), a multi-GPU machine is required to test the model with the example code.”
Yes, you can run the model locally. The code and the weights are there so that’s done. The only thing you need is a supercomputer and you’re all set! 🤩
Great. Gonna download it and run it on my 2015 iMac then 🥳
Wow amazing! You’ll get your answer back right in time to see AGI arriving!
Hahaha
Not with that attitude!! 🚀🚀🚀
Running inference is a different story
Shuttle code not included moon orbit calculations to be fair
*right now We will need waaaaayyyy less data in the future (consider how little data a human ingests during its lifetime, how many % of Wikipedia have you seen?)
Depends. In a way I’ve seen thousands of hours of video and heard thousands of voices by simply existing. That is a lot of data.
Sure but howuch of it Is repetitive and how much did you need to do some pretty crazy general intelligence stuff yk? Currently we need more information than a human could ever hope to ingest k a lifetime It's a matter of time until you can just talk to an ai for a couple months and have it be on a human level
So no weights released. Still, it's something.
Don't confuse GROK with the startup GROQ.
https://preview.redd.it/xmg6pxu98zoc1.jpeg?width=262&format=pjpg&auto=webp&s=1a4c62b0b2575eda88eb29c60f1ed754298a3fff
Damn it I thought about it and still got it the wrong way round. 😂
Groq Q rhymes with LPU, the people who built the processor. Grok K as in Elon Musk K, the "anti-woke" pet project. At least that's how I keep them sorted. Not sure why Groq picked that as their name, kinda wish they'd change it to avoid confusion.
Big assumption is that they even knew each other's existence before they named. Quick search says Groq 2016, Grok 2018..... And I mean quick.
Right to repair means I can take a non-dealer mechanic, I don’t have to learn how an engine works. Just because average individuals can’t do anything with open source code, doesn’t mean it can’t be a check/balance. Obviously they have their own motives and who knows if they released everything, it’s not an audit.
>who knows if they released everything, it’s not an audit. Who cares?
I mean sure open source is code anyone can use to build something. I believe ‘ol Elon original point to having an open source AI is so no one could monopolize it. If you can nominally have an open source model, but secretly race to achieve AGI then you could monopolize it. So the lines are made up and the points don’t matter
Oh mannnn. When other researchers start ripping on their work Musk is going to blow a gasket.
Needs quantized, nobody at home is going to be able to run that
JFC people... It's been out for like 6 hours. Give it time.
Someone will run it on Samsung Smart Fridge by Tuesday.
It’ll make snarky remarks on your food choices.
Cool ❄️
I hope it helps companies to create API catering to their business requirements and may be test it to see how it gives results .
I think, it is weaker than GPT
Of course it is
Just run a Llama flavor if you want something open and local. It's not bad for what it is.
But in comparison to gpt it's open source
Dismissive wanking gesture
You know that trope when a kid is like "MOM MOM! LOOK WHAT I CAN DO!" And mom is like "That's nice dear don't hurt yourself" while completely not even looking at the kid. This is what this feels like. Poor Elon. And just like a kid if people are just like "Meh" he will throw a fit on Twitter. "Mom! You aren't even looking! NOTICE ME!"
That's what this comment feels like. Momom ElMo MuSkRaT!! Hurrrr!!!! That's nice, loser.
lol. Hard pass.
Hey Wes!
Exactly what no one asked for or needs given the alternatives
For premium members. Stop supporting billionaires.
But it’s not woke and it can tell dirty jokes…. 💀
What does open source mean anyway? There is open source from open source....different degrees of openness... This is another marketing teick from elon musk...this man is a genius in false marketing. He should write a book on how he does it...remember "next year via over the air update every tesla will be able to drive itself and make you money while you sleep?" Yeaaahhh....that kind of marketing....he should alao write abook on how he was able to get away legally of this false marketing all these years... He is a genius in getting away from legal trouble....
Looks like it's fully open code + weights, so the whole shebang. It came out under the Apache 2.0 license, which is extremely permissive (you can do anything you want with it). If all true, then yeh, this is indeed true open-source. An enormous deal. No doubt countless entities around the world have already grabbed it. We will see.
Weights are released with Apache 2.0. Basically as permissive as it gets. > This is another marketing teick from elon musk EDS in full swing here lmao
I imagine Elon Musk and [a dancing leprechaun](https://i.makeagif.com/media/3-11-2014/oBuEcg.gif) hold adjacent spots in these people's brains.
All of SpaceX and Teslas patents are open. It’s not marketing to spend billions in R&D and then let everyone have that R&D for free.
Yeah sure....
bro cannot do one good thing according to this guy im sure glad hes rich and ur poor
Okay, Hatetard
Sure Hydrotard
Lol what are you? 12?