HN user

pajop

224 karma

coconut.ph co-founder dev evangelist at smart.com.ph

[ my public key: https://keybase.io/pageman; my proof: https://keybase.io/pageman/sigs/vlEZVbaWTrRpNoUN4dCNjdftNTg0jwMGRcy6AjXx_kY ]

b8c3d7 5001fa

Verifying my Blockstack ID is secured with the address 1CYFY4vktizavUqgQpjyvqWk4LH6wJRsBr https://explorer.blockstack.org/address/1CYFY4vktizavUqgQpjyvqWk4LH6wJRsBr

meet.hn/city/14.5904492,120.9803621/Manila

Socials:

- x.com/pageman

Interests:

Entrepreneurship, Startups

---

Posts93
Comments77
View on HN
hghalebi.github.io 2mo ago

Category Theory for Tiny ML in Rust

pajop
1pts0
github.com 5mo ago

ZeroClaw – Open Claw Rebuilt in Rust

pajop
1pts0
deepwiki.com 5mo ago

Deepwiki.com (Devin) documentation of Sutskever-30-implementations

pajop
1pts0
antigonejournal.com 5mo ago

All 13 Episodes of Kenneth Clark's Civilisation: A Personal View

pajop
2pts0
github.com 6mo ago

Sutskever 30 Essential Papers:Complete NumPy Implementations with Visualizations

pajop
3pts0
github.com 1y ago

An LLM trained only on data from certain time periods to reduce modern bias

pajop
4pts0
oli.show 1y ago

Practice your Lean 4 in gamified fashion

pajop
2pts0
smithery.ai 1y ago

Extend your agent with 2,707 capabilities via Model Context Protocol servers

pajop
1pts0
www.kaggle.com 1y ago

Google Whitepaper on Agents

pajop
1pts0
www.behindgeniusventures.com 1y ago

Behind Genius Ventures: Our Approach to Investing in Multimodal AI

pajop
2pts0
sites.elliott.computer 1y ago

One Minute Park: Visit Parks One Minute at a Time

pajop
2pts1
www.storycraft.gg 1y ago

StoryCraft Mobile Multiverse with Real and AI Friends

pajop
1pts0
generative-infinite-game.github.io 1y ago

Unbounded: A Generative Infinite Game of Character Life Simulation

pajop
1pts0
techcrunch.com 1y ago

Piramidal's Foundation Model for Brain Waves Can Supercharge EEGs

pajop
1pts0
aigrant.com 1y ago

AI Grant with $250K uncapped SAFE deadline August 9

pajop
2pts0
allendowney.blogspot.com 1y ago

There is still only one "hypothesis" test

pajop
2pts0
aimodelreview.com 1y ago

Compare 75 AI Models on 200 Prompts Side by Side

pajop
18pts3
twitter.com 2y ago

What do you have "unreasonably" high standards for?

pajop
2pts0
twitter.com 2y ago

Transformer by hand 5-min tutorial by Anna Rahn

pajop
1pts0
arxiv.org 2y ago

MuMath-Code on ArXiv

pajop
2pts0
www.goldmansachs.com 2y ago

Gen AI: Too much spend, too little benefit [pdf]

pajop
48pts30
arxiv.org 2y ago

Studying Bias in GANs Through the Lens of Race

pajop
1pts0
twitter.com 2y ago

Is there no way to just post an index.html page somewhere for free?

pajop
2pts4
img-js.github.io 2y ago

Mini-Canvas-Editor Example

pajop
1pts0
twitter.com 2y ago

Jennifer Hochschild walks back on comments about Harvard Extension School

pajop
1pts0
github.com 2y ago

LoftQ: LoRA-fine-tuning-aware Quantization

pajop
3pts4
www.npr.org 2y ago

A tilt toward safety stopped a scientist's virus research

pajop
2pts0
www.nature.com 2y ago

Math Models from Program Search (Google FunSearch) Using LLMs

pajop
4pts0
www.technologyreview.com 2y ago

Google DeepMind used an LLM to solve an unsolvable math problem

pajop
7pts0
twitter.com 2y ago

Martin Shkreli Twitter Spaces on SBC Going to MDC Brooklyn Jail

pajop
3pts0

hello @ihid - would love to support Exercism through the Insiders program as your site is great resource for developer education! Is there a way you can provide PPP (Purhasing Power Parity) pricing for people outside of the U.S. and Europe? For example if you use this PPP calculator https://ppp.jackmcdade.com/ and compute PPP pricing for the Philippines, $10/month feels more like $20.88. If you want to recalibrate it, the PPP Pricing would be P4.79. Thanks in advance!

Interesting commentary on the video: https://x.com/sumlenny/status/1749870142547255525

What if they revise and re-issue the video based on the comments?

The alternate titles suggested are also interesting:

“ A good wording could be: Почему я обратился в ЦРУ Почему я вышел на ЦРУ Почему я начал работать с ЦРУ Почему я написал ЦРУ Почему я пошел к ЦРУ (not "в ЦРУ", as the latter is for cadets who start their work for the agency) or even Почему я выбрал ЦРУ”

From Google translate:

“ A good wording could be: Why I turned to the CIA Why did I contact the CIA? Why I started working with the CIA Why did I write to the CIA Why did I go to the CIA (not ‘to the CIA’, as the latter is for cadets who start their work for the agency) or even Why I chose the CIA”

from the paper: https://arxiv.org/pdf/2310.08659.pdf

"LoftQ aims to solve the problem of the discrepancy between the quantized and full-precision model in the context of quantization and LoRA fine-tuning for Large Language Models (LLMs). By simultaneously quantizing an LLM and finding a proper low-rank initialization for LoRA fine-tuning, LoftQ significantly enhances generalization in downstream tasks."

Bard: https://bard.google.com/chat/31e0a3bb74b29b3b

"Based on the abstract, LoftQ aims to solve the performance gap observed when applying both quantization and LoRA fine-tuning to a pre-trained Large Language Model (LLM).

Here's a breakdown of the problem and LoftQ's approach:

Problem:

Quantization: Reduces the precision of model weights to save memory and computation, but can lower accuracy. LoRA fine-tuning: Improves accuracy on specific tasks by adding a low-rank adapter, but can struggle with quantized models. Combined approach: Applying both quantization and LoRA fine-tuning often leads to a performance gap compared to full fine-tuning. LoftQ's solution:

Simultaneous quantization and LoRA initialization: LoftQ proposes a novel framework that quantizes the LLM while also finding a suitable low-rank initialization for LoRA. This helps bridge the gap between the quantized and full-precision model. Improved generalization: This approach improves the model's ability to generalize well on downstream tasks, especially in challenging memory-constrained settings. Evaluation and results:

LoftQ is tested on various NLP tasks like question answering and summarization. It outperforms existing quantization methods, particularly in low-precision scenarios like 2-bit and 2/4-bit mixed precision. Overall, LoftQ tackles the challenge of combining quantization and LoRA fine-tuning for LLMs, leading to better performance and efficiency, especially in resource-limited environments."