AI i kraj zlatnog doba - koristite ih dok ne posku

Još jedan balon koji je počeo pucati...

Respect Drago!

Počeo si konačno pisati fantastične članke gdje se može saznati dosta toga i nekih info koje su svakom IT profesionalcu zlata vrijedne!

Ovisno o tome što radiš, 25 milijuna tokena i nije ne znam koliki broj i sigurno ne bi bilo dovoljno za vibe codeat Windozere. 

Pazi ovo:

Over nearly 2,000 Claude Code sessions across two weeks, Opus 4.6 consumed 2 billion input tokens and generated 140 million output tokens, a total cost just under $20,000.

I to je samo C kompajler, a C je poprilično jednostavan jezik po pitanju sintakse, fičra, itd. Moderni OS je za nekoliko redova veličine kompleksniji softver. Ma već za C++ kompajler bi bili potrošili valjda 200k dolara.

Većina C kompajlera je napisanu u C-u i/ili C++-u tako da je najimpresivniji dio ovog pothvata (barem meni) bilo "portanje" na Rust.

Naravno da bi bilo daleko impresivnije da je model "sam napisao" sve iz nule na osnovu specifikacije jezika (C23 standard, trenutno aktualan) i literature (npr. dragon book) vezane za razvoj kompajlera, ali nisam baš siguran da je ikakav LLM za to uopće sposoban.

 Kako su zaboga uspjeli potrošiti oko 14x više ulaznih tokena, nego izlaznih?

moderni OSovi imaju i po 100 milijuna linija, tako da ne bi bilo dosta. Naravno.
Taj C kompajler je bio nekakav eksperiment pa se nije štedilo. Razumljivo je da je potrošeno dosta. 

No nekako sam dojma da ljudi ne organiziraju, ne apstrahiraju, ne enkapsuliraju... jer ne moraju. Kod ionako piše stroj, pa nek radi. Štošta se može napraviti uz drastično manju potrošnju, ali "ništa me ne košta, pa što bih se trudio".

P.S. a tu je i činjenica da neke stvari mogu uredno napraviti i jeftiniji tj. primitivniji modeli (kao što pokazuje i primjer u originalnom članku D.G.)

 A iskreno kao i sve u zadnjih 15 godina... Pogledaj uber, glovo, wolt... prvo investitori upumpaju masu novaca da se posluje sa gubitkom i niskim cijenama i onda nakon što bude natjecanja sa konkurencijom koju izbrišu kreće dizanje cijena.

Hi there,

You're receiving this because you have a Copilot Pro or Pro+ subscription, and we want to notify you of some important updates.

GitHub Copilot isn't the same product it was a year ago. It has evolved from an in-editor assistant into an agentic platform capable of running long, multi-step coding sessions, using the latest models, and iterating across entire repositories. Agentic usage is becoming the default, and it brings significantly higher compute and inference demands.

To keep up with the way you use Copilot, we're transitioning to usage-based billing, and we want to give you enough time to prepare. If you're also an admin on a Copilot Business or Enterprise plan, you'll receive a separate email covering what's changing for your organization.

Last week, we made temporary updates to Copilot individual plans to improve reliability and performance ahead of the broader move to usage-based billing. We will loosen usage limits once usage-based billing is in effect.

What's changing on June 1

Premium request units, or PRUs, will be replaced by GitHub AI Credits which are a monthly allotment of credits consumed based on token consumption (input, output, and cached tokens) according to the listed API rates per model. This change aligns Copilot pricing with actual usage and is an important step toward a sustainable, reliable Copilot business and experience for all users.
Copilot code review’s agentic architecture runs on GitHub Actions. Copilot code review will now consume GitHub Actions minutes, in addition to GitHub AI Credits. These minutes are billed at the same per-minute rates as other GitHub Actions workflows.
Fallback experiences will no longer be available. Under the new model, usage will instead be governed by available credits.
Your plan pricing is unchanged: Copilot Pro remains $10/month and Pro+ remains $39/month, and each includes $10 and $39 in monthly AI Credits, respectively. Code completions and next edit suggestions stay included in all plans and do not use AI Credits. For other features, you'll need to wait for your monthly included usage to reset, purchase additional usage, or upgrade your plan.

To help you prepare for usage-based billing, we're launching a new billing preview page in early May that lets you calculate what April's usage would have been under the new billing model before it takes effect.

You can find more details on usage-based billing in our blog post and FAQ. We appreciate your patience as we build a more sustainable Copilot for everyone.