Статья
7338 открытий · Подборка открытий из открытого интернета, сначала новые.
-
fluffy rambles: ME/CFS + Fibromyalgia
At this point it is super clear that I probably have ME/CFS . This has not been determined by a doctor (not for lack of trying!), but by a lifetime of experience and the fact that the issues I have match the profile pretty much exactly. I’d be tempted to blame the bad case of COVID I got back in 2024 but the precursors were there for a long, long time, so if COVID did anything it was just to push me over an edge I had been approaching for a while.
busybee · EN
-
fluffy rambles: Accidental upgrade
So, a bunch of my services run, or rather, ran , on an old Intel NUC 8 that I bought back in 2020 and have mostly used as a “random stuff goes here” server. A year and a half ago the fan on it died, so I bought a cheap replacement fan on Amazon and all was good. And over time I started hosting more and more stuff on it, such as my owncast and PeerTube instances, and a few things for my home media streaming setup (which are also now accessible while traveling).
busybee · EN
-
Building Aligned Intelligence System. Part I: Creating GPT Assistant
In recent years, the field of natural language processing has witnessed a remarkable breakthrough with the advent of Large Language Models (LLMs). These models have demonstrated unprecedented performance in a wide range of language tasks, from text generation to question answering. However, the mathematical formulation of these models and the techniques used to fine-tune them for specific ta...
AstraBlog · EN
-
Building Aligned Intelligence System. Part II. Improving Large Language Models
In this post we will look at different techniques for steering LLMs behaviour to get desired outcomes, starting with some basic general principles such as writing a good prompt and ending with fine-tuning and augmenting models with external knowledge. Methods discussed in this post are mainly aimed at improving LLMs reliability and ensuring the consistency and factual accuracy of their...
AstraBlog · EN
-
Exploring Parallel Strategies with Jax
Training large language models either like GPT, LlaMa or Mixtral requires immense computational resources. With model sizes ballooning into the billions or sometimes even trillions of parameters, specialized parallelization techniques are essential to make training feasible. In this post, we’ll explore implementing some of these scaling strategies in Jax - a Python framework designed for hig...
AstraBlog · EN
-
Transformers Inference Optimization Toolset
Large Language Models are pushing the boundaries of artificial intelligence, but their immense size poses significant computational challenges. As these models grow, so does the need for smart optimization techniques to keep them running efficiently on modern hardware. In this post, we’ll explore key optimization strategies that are making LLMs faster and more memory-efficient. We’ll star...
AstraBlog · EN
-
Speculative Decoding: The Art of Guessing Well
Large Language Models spend most of their decoding time not computing, but waiting: every new token requires reading all of the model weights from memory, only to multiply them by a single vector. What if the model could check several tokens for the price of one? In this post we’ll derive speculative decoding from first principles, build a general framework that covers every modern drafte...
AstraBlog · EN