AI & ML interests

None defined yet.

Recent Activity

h-tonywu  updated a model about 13 hours ago
Hcompany/NeoMME-800M-Retriever-ST-late
h-tonywu  updated a model about 13 hours ago
Hcompany/NeoMME-800M-Retriever-ST-dense
h-tonywu  updated a model about 13 hours ago
Hcompany/NeoMME-800M-Retriever
View all activity

Articles

tonywu71 
published an article 8 days ago
view article
Article

NeoMME: an efficient Multimodal-native and Multilingual Encoder

Hcompany
90
sergiopaniego 
posted an update 8 days ago
view post
Post
2004
Can you do RL over taste?

I've spent some time reproducing, in the open, Surya N's idea of training a model to paint with code. It's a coding model that learns to paint watercolours by writing JS code, trained with GRPO. I used TRL and OpenEnv for this, with the whole pipeline running on Hugging Face.

The interesting part is that the reward has no correct answer, unlike a math problem. In this case it's based on the artistic preferences of the person who builds the dataset.

Everything is published: the environment, the reference pool, the trained adapters, every painting of every run with the code that made it, and a write-up with all the decisions, including the ones that went wrong.

Blog post: https://huggingface.co/blog/train-to-paint-with-code