Technology fan, Linux user, gamer, 3D animation hobbyist

Also at:

linuxfan@tube.tchncs.de

linuxfan@cheeseburger.social

  • 1 Post
  • 19 Comments
Joined 1 year ago
cake
Cake day: July 24th, 2023

help-circle



  • Probably better to ask on !localllama@sh.itjust.works. Ollama should be able to give you a decent LLM, and RAG (Retrieval Augmented Generation) will let it reference your dataset.

    The only issue is that you asked for a smart model, which usually means a larger one, plus the RAG portion consumes even more memory, which may be more than a typical laptop can handle. Smaller models have a higher tendency to hallucinate - produce incorrect answers.

    Short answer - yes, you can do it. It’s just a matter of how much RAM you have available and how long you’re willing to wait for an answer.







  • It’s probably a pain to set up in Windows. In Linux, it just works, there’s nothing to set up. I’m using it right now.

    OP really should have mentioned their OS.

    Edit: Actually, nevermind both my posts. I know DRI_PRIME works by using my APU for regular desktop activity, and routing discrete GPU output in whenever a game is being played. But I don’t know if it’s possible to make it use the dGPU all the time.

    Even if it did, it would only work inside the OS, so if you had to boot into the BIOS for anything, you wouldn’t have a display. So for all intents and purposes, it wouldn’t really work.


  • OpticalMoose@discuss.tchncs.detoSelfhosted@lemmy.worldHardware question
    link
    fedilink
    English
    arrow-up
    4
    arrow-down
    2
    ·
    6 months ago

    I just did a quick bing chat search (“does DRI_PRIME work on systems without a cpu with integrated graphics?”) and it says it will work. I can’t check for you because my CPUs all have graphics.

    I CAN tell you that some motherboards will support it (my ASUS does) and some don’t (my MSI).

    BTW, I’m talking about Linux. If you’re using Windows, there’s a whole series of hoops you have to jump through. LTT did a video a while back.






  • OpticalMoose@discuss.tchncs.detoFediverse@lemmy.worldPaid Servers?
    link
    fedilink
    English
    arrow-up
    1
    ·
    edit-2
    11 months ago

    I kind of feel the same way. When someone is offering service in exchange for pay, it signals that they’re serious about this and see it as a part time job at least, as opposed to someone just doing it as a hobby or just for a learning experience.

    In my search I found 3 that offer multiple services for a single donation/subscription:

    • Neat.Computer - Their terms of service weren’t strong enough for me
    • Tromsite.com - I didn’t like their Peertube upload policy
    • Tchncs.de - The one I ended up joining.

    I really wanted a smaller instance, but I just couldn’t find one that I was happy with.





  • In addition to what the others have said, we’ve lost some big and popular instances (Vlemmy, FMHY and others) along with the communities they had. Also, with the 2 biggest (lemmy.world and lemmy.ml) coming under attack every week, some users want to be on a smaller instance that’s under the radar.

    Finally, people want to choose an instance that fits their interests/beliefs. I chose mine mainly for what they don’t allow and who they’re defederated from, but to each his own.