Ruby in Jupyter Notebook

https://nbviewer.org/github/SciRuby/sciruby-notebooks/blob/master/getting_started.ipynb

by Alifatisk • 2 years ago

181 47 2 years ago

DagsEoress2• 2 years ago

Is any of this usable on hosted GPU notebooks (e.g. paperspace)?

I'm currently diving into Machine Learning using Python + Scikit-learn, and I'd love to one day replace Python with Ruby. But looking at the current ML ecosystem I don't see that happening. Does anyone have experience building (Supervised / Unsupervised) models using something other than Python (including deployment)?

qsort• 2 years ago

Nbviewer is just a service that lets you host notebooks, there is no computation there.

Does anyone have experience building (Supervised / Unsupervised) models using something other than Python (including deployment)?

XGBoost/LightGBM have a C API and can be used from pretty much anything, deployment is not a problem. Practically building models is more about dealing with data, the ecosystem tends to revolve around Python and R for that reason.

thibaut_barrere3• 2 years ago

Since you wrote "using something other than Python" and not necessarily only Ruby, definitely look into Livebook and Elixir, and the whole ecosystem around it, including:

- https://github.com/elixir-nx/axon Nx-powered Neural Networks

- https://github.com/elixir-nx/nx Multi-dimensional arrays (tensors) and numerical definitions for Elixir

- https://github.com/elixir-nx/scholar Traditional machine learning on top of Nx

- https://github.com/elixir-nx/bumblebee Pre-trained Neural Network models in Axon (+ Models integration)

- https://github.com/elixir-explorer/explorer Series (one-dimensional) and dataframes (two-dimensional) for fast and elegant data exploration in Elixir

- https://fly.io/blog/rethinking-serverless-with-flame/ (for offloading large work to remote containers)

- https://www.youtube.com/watch?v=RABXu7zqnT0 InstructorEx

And of course Livebook (https://livebook.dev)

Old but interesting video https://www.youtube.com/watch?v=g3oyh3g1AtQ (Bumblebee: GPT2, Stable Diffusion, and more in Elixir)

A talk on the upcoming Elixir conference (https://2024.elixirconf.com/schedule/#schedules) is actually titled "Livebook in the cloud: GPUs and clustered workflows in seconds".

DagsEoress2• 2 years ago

Very interesting, thanks for sharing! I didn't know Elixir was so invested in Machine Learning. I have a background in Erlang so I'll definitely dive in. Do you know of any individuals / companies that have had success with Elixir+ML in production?

michaelmior3• 2 years ago

It's certainly possible, but the provider would need to add support for the kernel. That is, I'm pretty sure you can't install a new kernel in these environments yourself.

xipho• 2 years ago

Perhaps not quite what you're looking for but Ankane does (a lot) of great work, e.g. https://github.com/ankane/torch.rb.

crabbone• 2 years ago

R and Julia have had integration with Jupyter for a long time.

Even so, trying to avoid Python in the world of Jupyter will put you in a very tough spot. In general, doesn't matter how much you dislike it, there's no real way around it. You'll have to face it in some capacity whether you like it or not.

isodev• 2 years ago

I love the idea. It's similar to what the Elixir folks have been working on with Livebook https://livebook.dev which seems somewhat more refined on the UI side + the benefits of distributed erlang/elixir (e.g. a livebook can interface with a live system and interact with the remote application/gpu etc).

michaelmior3• 2 years ago

Jupyter notebooks have been around for almost a decade now. The interesting piece here is adding Ruby as a language that can be used instead of the original Python. (There have been many other languages integrated with Jupyter as well.)

lucasoshiro2• 2 years ago

Jupyter means "Julia, Python, R", the three original languages that it was created for. Nowadays you can add support for many languages by using other kernels.

If you want to see the available kernels for each language you can check it here: https://github.com/jupyter/jupyter/wiki/Jupyter-kernels

pbowyer• 2 years ago

The Livebook UI is lovely. I'd like to see Jupyter get some love in this area.

nichochar3• 2 years ago

It heavily inspired us for https://srcbook.com (a TypeScript notebook)

thibaut_barrere3• 2 years ago

What is being presented at ElixirConf: https://x.com/josevalim/status/1828791276587934164

"What about using @livebookdev to spawn 64 machines with GPU on @flydotio, each machine fine-tuning BERT with different hyperparameters and graphing in realtime in 2-3 minutes?"

BaculumMeumEst4• 2 years ago

Does anyone have a way to use generative AI to generate Jupyter notebooks? I've tried with prompts but it chokes on the markup, and also I'm wondering if the markup wastes too much context for that to be a good idea anyways. Right now I just use Cursor or Claude, copy replies, and chop them up into blocks manually.

prasoonds4• 2 years ago

We've made an open source fork of Jupyter - kind of like Cursor but for Jupyter.

See GH: https://github.com/pretzelai/pretzelai/

You can install it with pip install pretzelai (in a new environment preferably) - then run it with pretzel lab. You can bring your own keys or use the default free (for now) AI server.

We also have a hosted version to make it easy to try it out: https://pretzelai.app

Would love to get your feedback!

BaculumMeumEst4• 2 years ago

Can it reliably generate interspersed blocks of markup and code with a single prompt?

Kalanos• 2 years ago

i thought there already was a ruby kernel.

are you the original developer or a new maintainer of iruby?

nomilk• 2 years ago

Rubyter notebook =)

joshdavham3• 2 years ago

This looks great! I’m already running Node as well as python in Jupyter notebooks so to see more languages being added is always great

nichochar3• 2 years ago

Do you like using Node in Jupyter? Are there any downsides / problems that you find with it?

We're trying to build a TypeScript notebook and I'm very interested in what people's current tooling for this looks like today.

joshdavham3• 2 years ago

I like being able to use Node in Jupyter, but I can't say that how I'm using it feels as natural as it does with Python. I'm way stronger at python than node so it was pretty hard to get set up with it.

There's also probably a way to do it, but I haven't figured out how to use ESModule imports in Jupyter, so that's been a bit annoying also. It also hasn't crossed my mind until literally now, that one could write typescript in jupyter notebooks given that typescript needs to be compiled.

Do you have a link to your current work? I think I'd be interested

quackware• 2 years ago

Deno has support for Jupyter notebooks which is quite nice.

https://docs.deno.com/runtime/manual/tools/jupyter/

DwnVoteHoneyPot• 2 years ago

This is a dead project. Everything in the SciRuby/sciruby-notebooks Github repository hasn't been updated in 8,9 years.

bunderbunder• 2 years ago

This page is talking about a project called iRuby, which I assume is unrelated or successor. The repository this page links had a 0.8.0 release exactly one month ago.

The same org does also have a sciruby project that hasn't been touched in 8 or 9 years like you say.

keithxm23• 2 years ago

While the example-notebooks repo you've mentioned is not actively maintained it looks like the IRuby kernel used by Jupyter still is maintained: https://github.com/SciRuby/iruby

bmacho• 2 years ago

Needs (2016)

vidarh• 2 years ago

This renders better for me straight from Github than it does on nbviewer.org:

https://github.com/SciRuby/sciruby-notebooks/blob/master/get...

turriblegrapes• 2 years ago

nbviewer has nothing to do with ruby specifically, this example links to a notebook using existing iruby kernel

nbviewer is an open source project under the larger Project Jupyter initiative > along with other projects like Jupyter Notebook, JupyterLab, and JupyterHub.

https://nbviewer.org/faq#what-is-nbviewer

kinduff• 2 years ago

There is also jupyter_on_rails [0] which integrates both. Using it feels so good, I love how an app can suddently become a playground or a sandbox.

[0] https://github.com/Yuki-Inoue/jupyter_on_rails

Alifatisk• 2 years ago

That's so bizzare yet cool!

portpecos• 2 years ago

Finally!!

Ruby in Jupyter Notebook

Related Stories