Meetups/Infra/2026-05-11
create page New page {{meetups/infra}} Monday, May 11, 2026, 7:00–8:30 PM. Shell, web services, self-hosting, networking! == Intros == * [name] - [background]. [goals for meetup, or interests to explore] - [what you’re hosting / hacking on / curious about this week.] * Loren - cloud infrastructure, interesting in rendering md files locally. * Ciara - play with linux and computer and kubernets and ?, self hosting maybe get into bi-os ? * Elan - self hosting, kubernetes, last dep now support py 3.14 * Daniel - web stuff, likes donations, built an awesome webpage, perpetually. * Derek - focusing on developer tools / specs, [...] dystopian scheduler. * Brandon - two companies: apricot, principal: respectively palenstine, and helps leave big tech. From Minn. Aspiration tech. * Doug - Likes to self-host, conjuring up software projects * Thomas - also likes to self-host, llms?, ? * Dan - likes computers to the full extent * Victor - works in platform stuff and dev tools, linux sandboxing with bubble wrap * Thom - software dev, person all projects, feeling guilty putting things on digital ocean, moved to the area 4 weeks ago * Thijs (like "dice" starts with "t") - moved here from the netherlands, failed at self hosting, * Kevin - likes computers and AI, ecosystem of coding agents and observability around them, opportunites around them. Real briefly, looking at TokenTelemtry project for analyzing token spend. Supports 8 coding agents. * Jet - got a new DSLR EOS Rebel T6i - benchmarking compiler options for Rust. * Erik - "mobile edge device (intel i9) 8GB VRAM / 64GB RAM" for kubernetes hosting, T1000 nvidia gpu (think station). Not a lot of room for context. * Ellie - really likes terminals, rust. Looking into TUI for terminal GUI. * Robert - interested in programming ingerneral * WE-Z - intersetion of verilog and pytorch, learning about Burn, a gpu tensor library in rust * Max - Here and tired, made it! * Eugene - Was outside touching actual grass today. (mention how to follow / add to notes) (add to template) (Thom - why guilty digital ocean?) () - Working on it over the weekend, instead of self hosting. == Tonight’s plan == * ‘’‘Requested topics page’’’ — new wiki subpage for ongoing intake. Quick demo of signing (<code>[[User:Mcint|Mcint]] ([[User_talk:Mcint|talk]]) [[mw:help:sign|<code><nowiki>--~~</nowiki><nowiki>~~</nowiki></code>]] 22:24, 20 May 2026 (PDT)</code>) and talk-page norms. * Joke RFC - X-Tacit knowledge is hard to transfer * ‘’‘glow-web’’’ — Loren: markdown reader in the browser, built on [https://charm.sh charm]/glow. Demo + sketch of where it’s going (history queue, diff view, blame-by-commit-age). ** https://github.com/mcint/glow-web/ ** go install github.com/mcint/glow-web/cmd/glow-web@latest *** (glow charm bracelet is lib for TUI) *** browse through files *** render with markdown hints *** side bar filter, hit cmd-k fuzzy bounce between files * (call to consider -- projects worth reading a changelog for) * VyOS - intro / discussion (see also networking intros) ** router operating system ** networking, hardware, handsoff preferred *** obtuse, archaic *** VyOS is fork of a fork Viata? edge router ubiquity toolkit **** Rational, bad security in router OSs black box vyos takes inspiration from the Cisco ecosystem designed for scriptability the operating system is designed around set commands set the hostname? $ set system host-name <ident> $ commit # save setting to linux stack (not permanent) $ save # persists through startup. It's just linux, gets patches just like linux. Designed for X86 only. A nuc running with two different ports at homelab and colo recently also installed at friends for pi-hole seems like a good idea to being linux into software world (freebsd pfSense?: https://www.pfsense.org/), gets all compat with linux networking engineers need automated rollbacks, a special proactive defense mechanism because easy to lock self out. Comes from the Cisco methodology mindset supports image management Perhaps update to a kernel you don't like download another release and upgrade to it, or downgrade supports multiple images to make updates smoother A set of toolkits built in offers wrappers around specific packages with extra care around updates. How sophisticated is rollback feature? Write-ahead log. Does: set "This is what I'm going to do. Then do the thing" Each set command sets the elements withing the config The writeahead log has a sequenece of steps is transparent The issue with MicroTik, locks into possibly vuln kernels. The nic drivers are linux for easy support. Most routers security is determined by configuration. * * Doug, sfmix ? * jet - fast token generation https://chatjimmy.ai/ https://taalas.com/products/ ** Weird product! AI Chat online. > "Are you a real AI chat?" > 14,000 token per second runs on Taalas.com can be finetuned Started two years ago Taalas HC1 tech demo runs only LLama 3.1, doesn't have any reasoning. coming out with second, medium sized reasoning model. Try a thinking question? > "Generate a fortran program to computer e to arbitrary precision" "Use SML" show an example of lifetimes in rust 2.5 kWatt server Support different type of sampling? $200M funding, 24 people * ‘’‘Changelog reading’’’ — pick a few projects, read for ~15 min, round-robin reports. '''''Report back: one notable change, one thing that surprised you, one thing worth following.''''' * https://endoflife.date/linux * https://endoflife.date/ others? ** linux kernel -- copy.fail, dirty frag -- what else big arrived -- deb or ubuntu, or other ** apache beam - py 3.14 update (no-GIL version available) Multithread everything? held up by small dependency on tensor flow ** token telemetry - what does the coding agent communicate to remote hosts? provides visilibity into what coding agents tend to offer and which MCPs are available. Constitutes a huge number of tokens. Context get accumulatively chewed up. ** python-telemetry - control what tokens end up in prompts ** Helm -- Ciara *** (Helm charts) ** suggestions: py: requests py: ... ** OpenSSL / ssl ** OpenSSH - Kevin low severity vulns were repaired ** CudaOxide * little question: openapi? (swagger implements openapi) ** docs == Changelogs -- == * OpenSSL - * Linux -- 6.12 -- realtime preemption deeper integration with eBPF support for printing qr-code on panic lkml.org * uv -- audit -- security audit came out in April. Checks lock-ed deps against Python Advisory database ** uv ? <3 - introduced in April $ uv self update # to get latest $ uv audit Resolved 54 packages in 4ms Found no known vulnerabilities and no adverse project statuses in 53 packages * Read dependencies from both pyproject.toml and uv.lock * Check all locked dependencies (including all dependency groups) against the Python Packaging Advisory Database * Generate a security report highlighting: ** Identified vulnerabilities ** Affected versions ** Bun was ported to Rust. test suite was really good. ported by LLMs in 4 days. W3C specs get negotiated between implementers Spec and Politics driven design. ** ABI changes for Fuscia? ** Nix policy changes automation policy assisted by which model or tool so it's clear to other devs their bottleneck is review. It's important that maintainers can review the flood of codegen contributions. ** Rust is adopting a more nuanced AI contribution policy ** GhosTTY maintainer: https://github.com/mitchellh/vouch vouch has denounce+commend feature transferable reputation ** apache beam - py 3.14 update (no-GIL version available) Multithread everything? -- GIL xfer is harder held up by small dependency on tensor flow ** TODO ** beam, == Outros == * Ciara - ai model - chatjimmy - energy efficient ai * Daniel - don't call me a genious, but i called weights burned into silicon years ago * Elan - uv audit -- really interesting * Derek - llm story thing, outstanding * Doug - reminded how little I know, nice to attend. Amazon S3 can now be used as a file store * Thomas - Scheduler? Into userspace, super cool * Dan - 7.whatever linux release candidate rc3. Rust extension has a section on safety * Victor - 7.0 compatilibty for Risc-V * Steve - ?? * Eugene - Taalas cool. ?! cerebras 4x faster than groq (why nvidia bought groq not cerebras) * Tom - surprised by inference speed of Taalas * Thijs - new things to look into `uv audit` * Kevin - good session, one-upsmanship game esp of calling things in advance, invented standing near other people and ignoring them (Doug had internet access in 1984) * Robert - VyOS thing very interested, lazy pushes? * Erik - VyOS sounded cool as ex-juno OS hater, has a NUC (next unit of compute) with two nics (don't forget Arista, top 3, router hate) * Max - really fast inference was really fast, ASIC AI is a fast thing. kind of mind blowing to get 100x speed up (18,000 tokens / second) end of the optimization? If we plateu, what we be able to do with on board inference 100 times faster than cloud APIs? * Ellie - Super interested with BUN news. Split! rewrite a thing in 4 days. But also,the test suite only checks node problems, imagine end up at some point with a whole class of issues? (Loren: Fuzzer in the loop) * Loren - uv audit -- (12 factor app) (Cisco OSes, Router operating system conflicts with Robot operating system) (Fish shell) () * == Dropped topics / not followed-up again == * Kevin - token telemetry * — other topics, requests, announcements. * ‘’‘tmux web session handler’’’ — Loren: claim the PyPI name live, walk through the flow. Tease two-way shell + multi-agent orchestration directions. * ‘’‘SSH agent + signing refresher’’’ — normal agent usage, then git commit signing via the agent. == Changelog reading — candidate projects == (pick your own; suggestions to seed) - - - - Report back: one notable change, one thing that surprised you, one thing worth following. == Announcements == - - == Action items / interest == - - == Links shared == -