HN user

tellarin

2,684 karma

e-mail: $id @ gmail.com twitter: https://twitter.com/tellarin hp: https://tellarin.com/borje/

Beijing Academy of Artificial Intelligence (BAAI). Ex-Microsoft Research Asia (MSRA), INdT/Nokia, etc.

Posts200
Comments347
View on HN
www.bbc.com 1mo ago

The medieval secrets being revealed by AI

tellarin
5pts0
huggingface.co 2mo ago

Show HN: Benchmarking Tangible Interface Understanding in Long-Horizon Tasks

tellarin
1pts1
www.bbc.com 2mo ago

A red pixel in the snow: How AI found a lost climber

tellarin
2pts1
www.bbc.com 2mo ago

UK gaming icon Peter Molyneux on AI, his final creation and a changing industry

tellarin
3pts2
huggingface.co 4mo ago

Switch: Benchmarking the Handling of TCIs in Long-Horizon Embodied Scenarios

tellarin
1pts0
emu.world 8mo ago

Emu3.5: Native Multimodal Models Are World Learners [pdf]

tellarin
2pts0
emu.world 8mo ago

Emu3.5: Native Multimodal Models Are World Learners [pdf]

tellarin
1pts0
www.bbc.com 9mo ago

How nervous are investors about the stock market?

tellarin
2pts1
www.bbc.com 9mo ago

Amazon unveils prototype AI smart glasses for its delivery drivers

tellarin
2pts0
www.bbc.com 9mo ago

Alaska Airlines flights grounded across US due to IT outage

tellarin
1pts0
www.bbc.com 9mo ago

Mosquitoes found in Iceland for first time after record heat

tellarin
2pts1
www.bbc.com 11mo ago

North Korea sent him abroad to be a secret IT worker

tellarin
112pts67
www.bbc.com 1y ago

How China made electric vehicles mainstream

tellarin
3pts0
www.bbc.com 1y ago

Can AI speak the language Japan tried to kill?

tellarin
21pts0
www.caixinglobal.com 1y ago

The Leading Players in China's Humanoid Robotic Revolution

tellarin
2pts0
fortune.com 1y ago

Sara Hooker: She makes AI accessible, no matter what language you speak

tellarin
1pts0
www.bbc.com 1y ago

Google drops pledge on AI use for weapons

tellarin
2pts1
www.bbc.com 1y ago

A team paid to break into top-secret bases

tellarin
56pts52
www.microsoft.com 1y ago

Microsoft Research Creation Plan – Original memo (1991) [pdf]

tellarin
3pts0
arxiv.org 1y ago

Multilingual Multimodal Data Hub and Benchmark for Southeast Asian Languages

tellarin
2pts0
www.caixinglobal.com 1y ago

China Humanoid Robot Industry on Track for Consolidation, Investor Says

tellarin
3pts0
www.caixinglobal.com 1y ago

IBM Pulls R&D Units Out of China in Latest Withdrawal by U.S. Firm

tellarin
2pts0
www.caixinglobal.com 1y ago

IBM Pulls R&D Units Out of China in Latest Withdrawal by U.S. Firm

tellarin
2pts0
www.businessinsider.com 2y ago

Microsoft is mandating its employees in China stop using Android phones for work

tellarin
15pts4
arxiv.org 2y ago

Multilingual Multimodal Data Hub and Benchmark for Southeast Asian Languages

tellarin
1pts0
arxiv.org 2y ago

Multilingual Multimodal Data Hub and Benchmark for Southeast Asian Languages

tellarin
1pts0
www.bbc.com 2y ago

'Spy mania': Why is Russia accusing its own physicists of treason?

tellarin
8pts2
www.bbc.com 2y ago

NASA 'Earthrise' astronaut dies at 90 in plane crash

tellarin
1pts0
www.wsj.com 2y ago

Microsoft Asks China AI Staff to Relocate Amid U.S.-China Tensions

tellarin
1pts0
www.microsoft.com 2y ago

Microsoft Research Creation Plan – Original memo (1991) [pdf]

tellarin
1pts0

Some collaborators and I recently released a first version of a benchmark we think highlights a critical gap in recent AI models in understanding causality in the real-world, beyond a physics focus.

Everyday environments are rich in tangible control interfaces (TCIs), like, light switches, appliance panels, and embedded GUIs, that are designed for humans and demand commonsense and physics reasoning, but also causal prediction and outcome verification in time and space (e.g., delayed heating, remote lights).

Paper: SWITCH: Benchmarking Modeling and Handling of Tangible Interfaces in Long-horizon Embodied Scenarios

Data and leaderboard in HuggingFace.

Feedback, suggestions, and collaborators are very welcome!

Selfless plug here... Some collaborators and I just released a first version of a benchmark we think highlights a critical gap in recent models in understanding causality in the real-world, beyond a physics focus.

Everyday environments are rich in tangible control interfaces (TCIs), like, light switches, appliance panels, and embedded GUIs, that are designed for humans and demand commonsense and physics reasoning, but also causal prediction and outcome verification in time and space (e.g., delayed heating, remote lights).

SWITCH: Benchmarking Modeling and Handling of Tangible Interfaces in Long-horizon Embodied Scenarios (https://huggingface.co/papers/2511.17649)

Feedback, suggestions, and collaborators are very welcome!

Google has DeepMind, Microsoft has Microsoft Research, Meta has FAIR.

It’s not trivial to foster such environments, but they do still exist in different forms.

Gemini Robotics 1 year ago

I’m actually working on a demo like this. Kinda. ;-)

Hope to share the details here soon.

Economic powerhouses? Sure. But forces for good? I don't think necessarily so.

Regarding the wealth thing, I'd really like to see some analysis that quantifies the risks of not having guaranteed health insurance. It is basically a gamble in the US. And even when tech companies pay for your insurance, it doesn't cover everything and can disappear at any moment if you are fired.

I'd also like to see some analysis of the impact of all the European companies that US companies acquire and integrated when they show promise. Not to mention that all the big tech companies have big offices with thousands of employees in Europe too. How much is this a wealth transfer either way?

[dead] 2 years ago

Wow! I knew there were some issues between him and regulatory agencies, but many more than I thought: FAA, DOJ, FCC, FTC, Interior, EEOC, NLRB, EPA, etc.

When I was in there in Microsoft Research, our team was working on related efforts. But, yes, while pieces have shipped into products, MS never released a complete solution at the time.

Some links that might be of interest:

- Table semantics: https://www.microsoft.com/en-us/research/project/table-inter...

- Entity semantics (video): https://onedrive.live.com/?authkey=%21AMIdbT4yVFaw2Kk&cid=A6...

- Natural Language in Spreadsheets: https://www.microsoft.com/en-us/research/project/gridbook/

We've built Cradle, a framework that leverages such models to perform complex computer tasks via the same general interface humans use: screen as input and keyboard & mouse operations as output.

It works both on regular software and in complex games like RDR2. And it doesn't cheat by using any game-/software-specific API, nor accessibility calls, nor DOM trees. :)

https://baai-agents.github.io/Cradle/

And we're still evolving it.