HN user

mccrory

53 karma
Posts1
Comments45
View on HN

My understanding is that it is a large collection of traits and that a person might have no traits or possibly even 1 or 2 that are very minor and NOT be on the spectrum. Someone else might have 1 severe trait and be on the spectrum and someone else might need 5 traits to be diagnosed as on the spectrum. Don’t think of it as a continuous spectrum but more of a collection of traits that are of little or no severity to high severity where as was mentioned before, the person has little or no quality of life.

MCNE/MCSE here from the mid-90’s, agree it was obvious that Netware would likely fade. Windows NT 3.51 (even though it wasn’t as good at the time), was more user friendly and had the Windows interface, compatibility, etc etc However, it NT wasn’t remotely as stable as Netware at that time either. Then we got to watch as Novell slowly went insane competing and buying WordPerfect and doing all sorts of other crazy moves. I still wish that Novell had taken all of its money and bought VMware when they were just working on GSX/ESX (now vSphere). This would have changed the trajectory of both Novell and the market.

What happens when the “few bad apples” get all of the traction and all of their news spreads vs good journalists who get very small readership? You end up with all perceived journalism being bad and the good being so diluted by the bad that their impact isn’t ever felt. I believe this is where we are headed if we aren’t already there now.

Sign me up for that, I made my own out of legos as a kid. I managed to make two of them that looked like robots and vehicles. Using just hinges and the small squares with rotating centers.

DuckDB-NSQL-7B

Model Description

NSQL is a family of autoregressive open-source large foundation models (FMs) designed specifically for SQL generation tasks.

In this repository we are introducing a new member of NSQL, DuckDB-NSQL. It's based on Meta's original Llama-2 7B model and further pre-trained on a dataset of general SQL queries and then fine-tuned on a dataset composed of DuckDB text-to-SQL pairs.

Training Data

200k DuckDB text-to-SQL pairs, synthetically generated using Mixtral-8x7B-Instruct-v0.1, guided by the DuckDB v0.9.2 documentation. And text-to-SQL pairs from NSText2SQL that were transpiled to DuckDB SQL using sqlglot.

Evaluation Data

We evaluate our models on a DuckDB-specific benchmark that contains 75 text-to-SQL pairs. The benchmark is available here.

Training Procedure

DuckDB-NSQL was trained using cross-entropy loss to maximize the likelihood of sequential inputs. For finetuning on text-to-SQL pairs, we only compute the loss over the SQL portion of the pair. The model is trained using 80GB A100s, leveraging data and model parallelism. We fine-tuned for 10 epochs.

Intended Use and Limitations

The model was designed for text-to-SQL generation tasks from given table schema and natural language prompts. The model works best with the prompt format defined below and outputs. In contrast to existing text-to-SQL models, the SQL generation is not contrained to SELECT statements, but can generate any valid DuckDB SQL statement, including statements for official DuckDB extensions.

How to Use

Example 1:

import torch from transformers import AutoTokenizer, AutoModelForCausalLM tokenizer = AutoTokenizer.from_pretrained("motherduckdb/DuckDB-NSQL-7B-v0.1") model = AutoModelForCausalLM.from_pretrained("motherduckdb/DuckDB-NSQL-7B-v0.1", torch_dtype=torch.bfloat16)

text = """### Instruction: Your task is to generate valid duckdb SQL to answer the following question.

### Input:

### Question: create a new table called tmp from test.csv

### Response (use duckdb shorthand if possible): """

input_ids = tokenizer(text, return_tensors="pt").input_ids

generated_ids = model.generate(input_ids, max_length=500) print(tokenizer.decode(generated_ids[0], skip_special_tokens=True))

Example 2:

import torch from transformers import AutoTokenizer, AutoModelForCausalLM tokenizer = AutoTokenizer.from_pretrained("motherduckdb/DuckDB-NSQL-7B-v0.1") model = AutoModelForCausalLM.from_pretrained("motherduckdb/DuckDB-NSQL-7B-v0.1", torch_dtype=torch.bfloat16)

text = """### Instruction: Your task is to generate valid duckdb SQL to answer the following question, given a duckdb database schema.

### Input: Here is the database schema that the SQL query will run on: CREATE TABLE taxi ( VendorID bigint, tpep_pickup_datetime timestamp, tpep_dropoff_datetime timestamp, passenger_count double, trip_distance double, fare_amount double, extra double, tip_amount double, tolls_amount double, improvement_surcharge double, total_amount double, );

### Question: get all columns ending with _amount from taxi table

### Response (use duckdb shorthand if possible):"""

input_ids = tokenizer(text, return_tensors="pt").input_ids

generated_ids = model.generate(input_ids, max_length=500) print(tokenizer.decode(generated_ids[0], skip_special_tokens=True))

Where is my M3 Ultra MacBook Pro? I’m okay with reduced battery if I can have 256GB of ram and the processing power.