So this wasn’t a post actually asking what a small LLM was good for, it was just an opportunity you could use to dump on LLM usage I take it. So this whole thing was made in bad faith?

With the comments about “vibe coding” and such, all it looks like you’re doing here is arguing the “merits” of how it’s being used, and you’re not interested in its actual usage at all.

Nobody is being pissy here except you. Small LLMs can be used for tasks such as this, and it doesn’t have to be twitch - It could be an assistant that you build for reminders in your personal life - using it on twitch is a minor detail that you seem to have latched onto because you just want to dump on LLM usage.

Go to /c/fuck_ai for that.

I gave you an example that it’s good for, and all you want to do is argue the merits of how I’m using it (even though it falls perfectly within Twitches TOS and use cases)

There’s not actually that much code. It’s like 8 lines for an AI ‘agent’, and maybe another 16 lines for ‘tools’, and I’m using Streamlink for grabbing the audio stream, and pulseaudio has a ‘monitor’ device you can use to listen to what’s playing on the speakers. Throw it on a very minimal linux distro on a VM, and that’s it.

I don’t do ‘vibe coding’, but that IS where I got the idea from. People who are doing ‘vibe coding’ nowadays aren’t just plugging things into a generic AI, they’re spinning up ‘agents’ and making tools via MCP and then those agents are tasked with specific things, and use the tools to directly write to files, search the internet, read documents, etc

You build a system to identify everyone in the park and collect recordings of their conversations? Absolutely a problem, depending on the jurisdiction.

Literally not. The police use this right now to record your location and time seen using license plates all over the nation - with private corporations providing the service.

and being in public doesn’t automatically entail consent to being recorded.

And yes, it’s called ‘expectation to the right of privacy’. Public venues are not ‘private’ locations, and thus do not need consent. You can, quite literally, record anyone in public.

Even the link you provided agrees.

I’m not storing their data. I’m feeding it to an LLM which infers things and storing that data.

Sorry, but 1850 takes precedence.

Since when did California adopt the Mexican flag that I see all over the protests there? If you’re America, and you’re fighting for American values, fly the American flag.

And I’m saying neither are fighting for US Democracy. Because they aren’t.

Yes. The small LLM isn’t retrieving data, it’s just understanding context of text enough to know what “Facts” need to be written to a file. I’m using the publicly released Deepseek models from a couple of months ago.

If I say my name is Doo doo head, in a public park, and someone happens to overhear it - they can do with that information whatever they want. Same thing. If you wanna spew your personal life on Twitch, there are bots that listen to all of the channels everywhere on twitch. They aren’t violating any laws, or Twitch TOS. So, *buzzer* WRONG.

Right now, the same thing is being done to you on Lemmy. And Reddit. And Facebook. And everywhere else.

Look at a bot called “FrostyTools” for Twitch. Reads Twitch chat, Uses an AI to provide summaries of chat every 30 minutes or so. If that’s not violating TOS, then neither am I. And thousands upon thousands of people use FrostyTools.

I have the consent of the streamer, I have the consent of Twitch (through their developer API), and upon using Twitch, you give the right to them to collect, distribute, and use that data at their whim.

That hasn’t been a problem at all for the 200+ users it’s tracking so far for about 4 months.

I don’t know a human that could ever keep up with this kind of thing. People just think he’s super personable, but in reality he’s not. He’s just got a really cool tool to use.

He’s managed some really good numbers because being that personal with people brings them back and keeps them chatting. He’ll be pushing for partner after streaming for only a year and he’s just some guy I found playing Wild Hearts with 0 viewers one day… :P

Currently I’ve been using a local AI (a couple different kinds) to first - take the audio from a Twitch stream; so that I have context about the conversation, convert it to text, and then use a second AI; an LLM fed the first AIs translation + twitch chat and store ‘facts’ about specific users so that they can be referenced quickly for a streamer who has ADHD in order to be more personable.

That way, the guy can ask User X how their mothers surgery went. Or he can remember that User K has a birthday coming up. Or remember that User G’s son just got a PS5 for Christmas, and wants a specific game.

It allows him to be more personable because he has issues remembering details about his users. It’s still kind of a big alpha test at the moment, because we don’t know the best way to display the ‘data’, but it functions as an aid.

Almost all of them are traitors to their country. You won’t see them at protests, and usually they’re just thin-blue-line gang members. They don’t fly the American flag, they fly a rendition of it that’s clearly altered to show their black and white view of the world.

Like I said - In LA, people flying Mexican flags aren’t fighting for American Democracy.

And in the Whitehouse, clearly they’re flying Russian flags and not fighting for (but actively dismantling) American Democracy there.

I hate being politically consistent. There’s no cognitive dissonance, but you still get…this.

TV panels have lower PPI than monitors.

It looks grainy because it’s a damn TV and not a monitor. You’re not going to be able to tell the difference AT THE DISTANCE that you’re supposed to be using them at. Larger monitors are meant to be used from a farther distance away. TVs are meant to be used from across the room.

You’re that guy with his retina plastered on the glass of his smartphone going “I CAN SEE THE PIXELS!”

Lossless Scaling (on Steam) has also shown HUGE promise from a 2-GPU standpoint as well. I’ve seen some impressive results from people piping their NVidia cards, into an Intel GPU (on-die or discreet) and using a dedicated GPU for the upscaling as well.

I’m starting to have a sneaking suspicion that putting 24G of VRAM on a card isn’t happening because they don’t want people using AI models locally. The moment you can expect the modern gamers computer to have that kind of local computing power - is the moment they stop getting to slurp up all of your data.