Stalking the Statistically Improbable Restaurant with Data 1 year ago
not in New Jersey and New York City. There are many high end variante of both
HN user
tspann
7 karma
Posts6
Comments21
github.com 2y ago
GI
look at sales engineering or make your owen AI startup. lots of seed money especially for MIT grad
Just use Apache NiFi
Dismantling ELT: The Case for Graphs, Not Silos 2 years ago
reminds me nifi plus kafka
Inkeep has been very solid for us and running in our Discord. https://milvus.io/community
Robert spoke at our meetup and is awesome. https://www.youtube.com/watch?v=35JdjmiDvWI
https://milvus.io/docs/integrate_with_llamaindex.md
Pretty easy to run local and lightweight with Milvus Lite with LlamaIndex
Kafka as an Antipattern 3 years ago
On my laptop even a demo with 5000 records a second seems almost too few for Kafka.
Use Apache NiFi instead
Bell Labs Holmdel Complex (2019) 3 years ago
I host a meetup there sometimes, it feel so Blade Runner run out of electric. https://www.meetup.com/futureofdata-princeton/
Ask HN: Could you share your personal blog here? 3 years ago
Barnes and Noble's surprising turnaround 4 years ago
That is good to hear. I worked in their ecommerce group for a year and it was interesting. Nice people. Surviving Amazon is amazing.
Let's Monitor All the Things 4 years ago
My setup for a recent talk at Current Event 22 in Austin.
I often need Dataflow, Spark Engineering, NoSql and Sql datastores, enterprise security and hybrid cloud with my datascience https://docs.cloudera.com/machine-learning/cloud/product/top...
I use Streams Messenging Manager supports schema registry for avro. Also includes alerts and many metrics and stats
Apache Drill's Future 6 years ago
Just use a Apache NiFi fast and does that on 1 step
Kafka for events Flink for continous sql against topic events Kudu for event storage. Databases for data storage and queries
Apache NiFi 6 years ago
Apache NiFi 6 years ago
Thanks! I wrote a few more of those. https://github.com/tspannhw/ExecuteClouderaML
Apache NiFi 6 years ago
No more XML. Check out NiFi 1.11.4, it does everything you need for easy ingest. If you are reading some files putting them into Kafka or S3 or a database or MongoDB or Hbase or Hive or Impala or Oracle or Kudu or ..., it's genius.
KafkaHQ 7 years ago
SMM is another option and has some really cool features for alerting as well. Runs in any cloud or on premise.
https://blog.cloudera.com/smm-1-2-released-with-powerful-new...