Not sure what device you use to access Reddit, but have you tried the revanced patched APK on android? This might just solve your problem.

Try either orinth 1.5 9b, or if it will fit orinth 1.5 35b a3b. I run 35 a3b on my 7gb rx7600. I use the iq4_xs quant. They are based on qwen3.6 but with some post training. Stuff to make the think and tool call better.

You’re determined that I worry about my public server aren’t you? Your initial question wasn’t actually a question, but just a trap for you to lure me into to be converted to your way of thinking?!?! rumbled! 😂 There are always experts to quote for any argument. Personally, I don’t feel any more vulnerable than before ai decimated the security landscape.

Maybe not, but maybe, just maybe, the people with these exploits aren’t running round attacking Joe bloggs personal photo album server to steal some photos, but in fact are only using the exploit very carefully and sparingly so as not to be detected, and only targeting high value and highly confidential services, where even if they were hacked or a specific exploit was deployed, either are too big to notice, or to proud to divulge the fact they lost some data 🤷

To me there is no increased threat landscape. The world is a scary place, full of baddies trying to get you. Since the dawn of the internet there has been vulnerabilities being found and used maliciously. Just because the big tech sota models are shouting about how great they are by finding them, giving them some nice free marketing, doesn’t mean that much has changed.

Ok, ai has increased the frequency and amount being found, but that is equally increased both for malicious and cybersec, so it essentially cancels out.

My server is public facing and secure, so that both myself, family and friends can use it, especially for the less tech savvy.

10000% correct! I bet the NSA or KGB has had that PHP exploit for close to a decade and they are gutted its finally been patched! There are probably an infinite number of vulnerabilities in currently running servers and clients, a few 100 will already be known and being quietly exploited. Yes, ai will find some completely unknown ones for malicious actors, but it will also find those same ones for cybersec bods, so effectively cancel each other out.

Thats exactly what all this is. If the SOTA models find a “critical” vulnerability every month or so, they get a huge shout out in the news and press globally which is some really appreciated and positive free marketing. Yes, ai has changed alot of things, some for the good some for the bad, but i dont feel like online risk has changed massively. AI finds vulnerabilities for milicious actors and cybersec bods quicker and more regularly than pre-ai, but both sides have the same tools so the same improvements, net effect is they cancel each other out. Anybody with serious about there stuff online already has sytems and processes setup to deal with patching stuff immediately. i barely touch my server for maintenance, just check stuff when im bored and make sure everything is doing what it should.

I have no idea what you are on about. What do you want me to do? Turn the internet off? Lock my doors and not leave the house? Sit here crying and quivering because the world is gonna end? My head is deffo not in the sand, I’m looking out the window at the rain, enjoying my life, looking forward to tomorrow.

I’m not worried about my web server any more today then I was last year. It’s a web server, it’s not me or my life, yes it how important stuff, but if the world ends it’ll be the last thing I think of.

My web server is as safe as it needs to be. Thanks for your concern.

Not at my pc now, but it’s fairly big. I use pi harness, with a searxng instance, plus a custom sandbox and a read only mount point and a full write mount point plus office tools and coding tools. I use a context window of 130k tokens with auto compaction.

Ai tomorrow better than ai today? Yes, that is true any day of any year. I don’t get your point 🤷

A vulnerability was found, that vulnerability was patched. I think it’s great news that vulnerabilities are being found and fixed faster than ever. Do you agree?

To be fair, my server has been public facing for the entire time these ai models have been finding vulnerabilities.

Without knowing your hardware, it’s impossible to give you advice.

I’m on an 8gb rx7600 with a 5700x CPU with 64gb 3600mts ram.

I use llama.cpp with the rocm driver, then have a custom sandbox for coding and heavily restricted filesystem access, all setup in pi harness, with access to a searxng instance for web search. Using orinth1.5 35b a3b on the iq4_xs unsloth quant.

This gives me the full ability to do anything, from creating reports, coding projects and fairly complex tasks.

I also have stable diffusion setup for image generation with flux 2 klein 4b, which is using qwen4 4b.

I’m on an rx7600 too. I have done loads of testing and benchmarking and the best model is orinth1.5 35b a3b. I get around 40tok/s generation from it. I run it with llama.cpp with the rocm driver, and use the iq4_xs unsloth quant. It’s based on qwen3.6 35b a3b, but trained on complex thinking and took calling. It’s miles ahead of anything else I’ve tried.

I’m not worried. I have auto updates on and have a well hardened setup following all the good basic principles. I have had a fully public facing server for years with no issues. My php was patched and updated totally automatically a few hours after the update became available. My web server is extremely low volume traffic and there is hardly any reason for random people to be using it, so chances of somebody attempting something against it at just the right time a vulnerability has been discovered but not patched is very low chance. When a critical vulnerability appears, hackers are going to target the big fish for big wins initially, even so, it takes effort to turn a vulnerability into an actual exploit and deploy it. I could step out my front door and get run over by a bus, but I don’t worry about it and stay on doors all day to mitigate the risk.

You’re not me. You will have different tastes too me. No point you using the distros I like. Do what everybody else does, experiment, try a few, read about them. The are loads out there all with little quirks and differences. Try L/K/X/Ubuntu, try cachyos / arch, try void, try Gentoo, try popos… Have a look at distrowatch for loads of inspiration.

Any and all distros can use and run any software any other distro runs so they can all do the same stuff, just they all get there in slightly different ways.

Yeah, I know how to do that very easily, but I don’t want to have my pc running 24/7 just so I can use the llm when I’m out of the house. My heaviest use is at home. It’s a large power requirement for minimal use.

Yeah, I have a fairly useable setup although it’s only accessible on my lan. I have a web server but it doesn’t host the llm as it’s not powerful enough.

Rx7600 8gb vram GPU 5700x CPU 64gb 3600mts ram

Hosting ornith 35b a3b iq4_xs Llama.cpp server Pi harness or llama.cpp webui Searxng web search Coding sandbox Restricted filesystem access

Get around 40 tok / sec and it’s really useable. Not as good as Claude sonnet, but good enough for most things.

I host my own Lemmy instance, but only because I spent the last 3 years learning to host other stuff. It’s taken a lot of effort and time to figure it all out and get it working, and the only reason I bothered was because it interested me. Most people aren’t that interested in how it all works and just want to use a working thing.

AHH cool, I didn’t thought both 3.8 models were on 4 architecture, I’ll edit my previous comment 👍

I don’t really understand your comment? Qwen3.8 27b is qwen4 architecture as a pre-release. apparently i was wrong here, it’s still on the 3.5 architecture.

A 27b dense model is really difficult to compare to a 35b a3b Moe model. I tried to run qwen3.8 27b on my 8gb card and ok it runs technically, but in no way is it viable or does it come close to ornith 1.5 35b a3b, mostly because to run qwen3.8 27b, I have to choke it to almost useless levels by running an aggressive quant like a 1, 2, or 3 bit quant, and even then it doesn’t run as fast.