Location: Fort Collins, CO
Remote: preferred
Willing to relocate: no
Technologies: typescript / javascript / vue / react / graphql / java / rust / sql
Résumé/CV: https://jordanmajd.com/cv.html
Email: me [at] jordanmajd [dot] com
I’m a full stack dev with 13+ years experience building everything from enterprise applications to VR / AR apps (even firmware for margarita machines ). I’ve led teams to build scalable cloud apps by providing a solid architecture, strong design patterns, reusable abstractions and accessibility guidelines. Teaching helped me realize I'm energized by mentoring others and supporting my team’s development.
Location: Fort Collins, CO
Remote: preferred
Willing to relocate: no
Technologies: typescript / javascript / vue / react / graphql / java / rust / sql
Résumé/CV: https://jordanmajd.com/cv.html
Email: me [at] jordanmajd [dot] com
I’m a full stack dev with 13+ years experience building everything from enterprise applications to VR / AR apps (even firmware for margarita machines ). I’ve led teams to build scalable cloud apps by providing a solid architecture, strong design patterns, reusable abstractions and accessibility guidelines. Teaching helped me realize I'm energized by mentoring others and supporting my team’s development.
In my case just CPU (it's a Hetzner server, checked in /proc/cpuinfo and it said "AMD EPYC 9454P 48-Core Processor"). I apparently had still in terminal backlog some stats, so I pasted below.
It's not a speed demon but enough to mess around and test things out. Thinking can sometimes be pretty long so it can take a while to get responses, even if 6 tokens/sec is pretty good considering pure CPU setup.
---
prompt eval time = 133.55 ms / 1 tokens ( 133.55 ms per token, 7.49 tokens per second)
eval time = 392205.46 ms / 2220 tokens ( 176.67 ms per token, 5.66 tokens per second)
total time = 392339.02 ms / 2221 tokens
(IIRC slot save path argument does absolutely nothing unless and is superfluous, but I have been pasting a similar command around and been too lazy to remove it). -ctk q8_0 reduces memory use a bit for context.
I think my 256gb is right at the limit of spilling a bit into swap, so I'm pushing the limits :)
The --min-p 0.1 was a recommendation from Unsloth page; I think because the quant is going so low in bits, some things may start to misbehave and it is a mitigation. But I haven't messed around enough to say how true that is, or any nuance about it. I think I put --temp 0.6 for the same reason.
To explain to anyone not aware of llama-server: it exposes (a somewhat) OpenAI-compatible API and then you can use it with any software that speaks that. llama-server itself also has a UI, but I haven't used it.
I had some SSH tunnels set up to use the server interface with https://github.com/oobabooga/text-generation-webui where I hacked an "OpenAI" client to it (that UI doesn't have it natively). The only reason I use the oobabooga UI is out of habit so I don't recommend this setup to others.
For years people have dogged on North Korea, Iran, China and Russia talking about how the government controls information by banning apps and by creating firewalls blocking access to parts of the internet. Now when the US introduces censorship people like you welcome it with open arms. Something of value is lost, our ability to access information freely
No, it's a perfect analogy, you just don't like it. If you actually had a valid point, you'd bother to explain the issue, but you didn't. Telling.
The US isn't censoring it based on content anyway -- in fact, the US government's ability to censor much of anything based on content is severely constrained by the First Amendment -- the US doesn't like the fact that it's controlled by the PRC. But blocking businesses from a rival nation is a trade issue, not a speech issue.
China is a rival and opponent of the US on the geopolitical stage. It's entirely reasonable to respond to trade restrictions with trade restrictions.
Exactly, Instagram started as a way for me to interact with my social circle. Show people I personally know what is going on in my life and see what is going on in their life. Instagram later on has slowly tried evolving into something else, but mentally I still view it as a place to share with people in my life. On the other hand, Tiktok is a both a global community and a small niche of people who share the same interests as you where you can make memes, enjoy the same content together, converse and witness trends and ideas in real time
LMK if you think I'd be a good fit!