HN user

Shelnutt2

463 karma
Posts16
Comments93
View on HN

TileDB, Inc. | Full-Time | REMOTE | USA | Greece | https://tiledb.com

TileDB is the database for complex data, allowing data scientists, researchers, and analysts to access, analyze, and share any data with any tool at global scale. All data — tables, genomics, images, videos, location, time-series — across multiple domains is captured as multi-dimensional arrays. TileDB offers extreme interoperability via numerous APIs and tool integrations across the data science ecosystem, eliminating the hassles and inefficiencies of data conversion. TileDB Cloud implements a totally serverless infrastructure and delivers access control, easier data and code sharing and distributed computing at global scale, eliminating cluster management, minimizing TCO and promoting scientific collaboration and reproducibility.

TileDB, Inc. was spun out of MIT and Intel Labs in May 2017 and is backed by Two Bear Capital, Nexus Venture Partners, Uncorrelated Ventures, Intel Capital and Big Pi.

Recent press-release for our Single-Cell API 1.0 release: https://www.businesswire.com/news/home/20230328005380/en/Til...

Website: https://tiledb.com

GitHub: https://github.com/TileDB-Inc/TileDB

Docs: https://docs.tiledb.com

Blog: https://tiledb.com/blog

Our headquarters are located in Cambridge, MA and we have a subsidiary in Athens, Greece. We offer the ability to work remotely for anyone with legal residence in the US or Greece.

We have several open positions aimed at increasing TileDB’s feature set, growth and adoption. You will have the opportunity to work on innovative technology that creates impact on challenging and exciting problems in Genomics, Geospatial, Time Series, and more. Immediate features on the roadmap for TileDB Cloud include, advanced distributed computations, advanced computation pushdown, improved multi-cloud deployments and more.

We are actively seeking:

- Infrastructure Engineer / Site Reliability Engineer

- Frontend Engineer - UI and React

- Javascript library Engineer

- Senior Software Engineer: Backend (Golang, CGo, k8s, Terraform, MySQL/MariaDB)

- Senior Software Engineer: Python API (pybind11, Python, C++, CMake, scikit-build, conda)

- Senior Software Engineer: Python Data Science Tooling (Jupyter plugins)

- Senior Software Engineer: Build (CMake, C++, conda)

- Senior+ Software Engineer: Database Internals (C++, database query planning/execution, distributed execution)

Apply today at https://tiledb.workable.com !

TileDB, Inc. | Full-Time | REMOTE | USA | Greece | https://tiledb.com

TileDB is the database for complex data, allowing data scientists, researchers, and analysts to access, analyze, and share any data with any tool at global scale. All data — tables, genomics, images, videos, location, time-series — across multiple domains is captured as multi-dimensional arrays. TileDB offers extreme interoperability via numerous APIs and tool integrations across the data science ecosystem, eliminating the hassles and inefficiencies of data conversion. TileDB Cloud implements a totally serverless infrastructure and delivers access control, easier data and code sharing and distributed computing at global scale, eliminating cluster management, minimizing TCO and promoting scientific collaboration and reproducibility.

TileDB, Inc. was spun out of MIT and Intel Labs in May 2017 and is backed by Two Bear Capital, Nexus Venture Partners, Uncorrelated Ventures, Intel Capital and Big Pi.

Recent press-release for our Single-Cell API 1.0 release: https://www.businesswire.com/news/home/20230328005380/en/Til...

Website: https://tiledb.com

GitHub: https://github.com/TileDB-Inc/TileDB

Docs: https://docs.tiledb.com

Blog: https://tiledb.com/blog

Our headquarters are located in Cambridge, MA and we have a subsidiary in Athens, Greece. We offer the ability to work remotely for anyone with legal residence in the US or Greece.

We have several open positions aimed at increasing TileDB’s feature set, growth and adoption. You will have the opportunity to work on innovative technology that creates impact on challenging and exciting problems in Genomics, Geospatial, Time Series, and more. Immediate features on the roadmap for TileDB Cloud include, advanced distributed computations, advanced computation pushdown, improved multi-cloud deployments and more.

We are actively seeking:

- Infrastructure Engineer / Site Reliability Engineer

- Frontend Engineer - UI and React

- Javascript library Engineer

- Senior Software Engineer: Backend (Golang, CGo, k8s, Terraform, MySQL/MariaDB)

- Senior Software Engineer: Python API (pybind11, Python, C++, CMake, scikit-build, conda)

- Senior Software Engineer: Python Data Science Tooling (Jupyter plugins)

- Senior Software Engineer: Build (CMake, C++, conda)

- Senior+ Software Engineer: Database Internals (C++, database query planning/execution, distributed execution)

Apply today at https://tiledb.workable.com !

Exactly what I felt too. Jumbo rocket on first launch spinning, feels right at home, just missing Jeb/Valentina :).

Big kudos to the whole SpaceX team, and all the surrounding people who have gotten things this far and I'm exciting for the next attempt!

Hello robbat2, there are some options available for folks not in the USA or Greece. We are most interested in finding the right people than their locations. I'd recommend you go ahead and apply. Feel free to also reach out directly at careers@tiledb.com.

TileDB, Inc. | Full-Time | REMOTE | USA | Greece | https://tiledb.com

TileDB is the database for complex data, allowing data scientists, researchers, and analysts to access, analyze, and share any data with any tool at global scale. All data — tables, genomics, images, videos, location, time-series — across multiple domains is captured as multi-dimensional arrays. TileDB offers extreme interoperability via numerous APIs and tool integrations across the data science ecosystem, eliminating the hassles and inefficiencies of data conversion. TileDB Cloud implements a totally serverless infrastructure and delivers access control, easier data and code sharing and distributed computing at global scale, eliminating cluster management, minimizing TCO and promoting scientific collaboration and reproducibility.

TileDB, Inc. was spun out of MIT and Intel Labs in May 2017 and is backed by Two Bear Capital, Nexus Venture Partners, Uncorrelated Ventures, Intel Capital and Big Pi.

Recent press-release for our Single-Cell API 1.0 release: https://www.businesswire.com/news/home/20230328005380/en/Til...

Website: https://tiledb.com

GitHub: https://github.com/TileDB-Inc/TileDB

Docs: https://docs.tiledb.com

Blog: https://tiledb.com/blog

Our headquarters are located in Cambridge, MA and we have a subsidiary in Athens, Greece. We offer the ability to work remotely for anyone with legal residence in the US or Greece.

We have several open positions aimed at increasing TileDB’s feature set, growth and adoption. You will have the opportunity to work on innovative technology that creates impact on challenging and exciting problems in Genomics, Geospatial, Time Series, and more. Immediate features on the roadmap for TileDB Cloud include, advanced distributed computations, advanced computation pushdown, improved multi-cloud deployments and more.

We are actively seeking:

- Infrastructure Engineer / Site Reliability Engineer

- Frontend Engineer - UI and React

- Javascript library Engineer

- Senior Software Engineer: Backend (Golang, CGo, k8s, Terraform, MySQL/MariaDB)

- Senior Software Engineer: Python API (pybind11, Python, C++, CMake, scikit-build, conda)

- Senior Software Engineer: Python Data Science Tooling (Jupyter plugins)

- Senior Software Engineer: Build (CMake, C++, conda)

- Senior+ Software Engineer: Database Internals (C++, database query planning/execution, distributed execution)

Apply today at https://tiledb.workable.com !

TileDB, Inc. | Full-Time | REMOTE | USA | Greece | https://tiledb.com

TileDB transforms the lives of analytics professionals and data scientists with a universal database, allowing them to access, analyze, and share any data with any tool at global scale. TileDB unifies the way we think about data, delivering superior performance and foundational data management capabilities. All data — tables, genomics, images, videos, location, time-series — across multiple domains is captured as multi-dimensional arrays. TileDB offers extreme interoperability via numerous APIs and tool integrations across the data science ecosystem, eliminating the hassles and inefficiencies of data conversion. TileDB Cloud implements a totally serverless infrastructure and delivers access control, easier data and code sharing and distributed computing at global scale, eliminating cluster management, minimizing TCO and promoting scientific collaboration and reproducibility.

TileDB, Inc. was spun out of MIT and Intel Labs in May 2017 and is backed by Two Bear Capital, Nexus Venture Partners, Uncorrelated Ventures, Intel Capital and Big Pi.

Recent HN article: https://news.ycombinator.com/item?id=23896131

Website: https://tiledb.com

GitHub: https://github.com/TileDB-Inc/TileDB

Docs: https://docs.tiledb.com

Blog: https://tiledb.com/blog

Our headquarters are located in Cambridge, MA and we have a subsidiary in Athens, Greece. We offer the ability to work remotely. If you are located outside of the USA and Greece we have options to accommodate this, don't hesitate to apply!

We have several open positions aimed at increasing TileDB’s feature set, growth and adoption. You will have the opportunity to work on innovative technology that creates impact on challenging and exciting problems in Genomics, Geospatial, Time Series, and more. Immediate features on the roadmap for TileDB Cloud include, advanced distributed computations, advanced computation pushdown, improved multi-cloud deployments and more.

We are actively seeking:

- Senior Golang Engineer

- Senior Python Engineer

- Site Reliability Engineer

- React Frontend Engineer

Apply today at https://tiledb.workable.com !

TileDB, Inc. | Full-Time | REMOTE | USA | Greece | https://tiledb.com

TileDB transforms the lives of analytics professionals and data scientists with a universal database, allowing them to access, analyze, and share any data with any tool at global scale. TileDB unifies the way we think about data, delivering superior performance and foundational data management capabilities. All data — tables, genomics, images, videos, location, time-series — across multiple domains is captured as multi-dimensional arrays. TileDB offers extreme interoperability via numerous APIs and tool integrations across the data science ecosystem, eliminating the hassles and inefficiencies of data conversion. TileDB Cloud implements a totally serverless infrastructure and delivers access control, easier data and code sharing and distributed computing at global scale, eliminating cluster management, minimizing TCO and promoting scientific collaboration and reproducibility.

TileDB, Inc. was spun out of MIT and Intel Labs in May 2017 and is backed by Two Bear Capital, Nexus Venture Partners, Uncorrelated Ventures, Intel Capital and Big Pi.

Recent HN article: https://news.ycombinator.com/item?id=23896131

Website: https://tiledb.com

GitHub: https://github.com/TileDB-Inc/TileDB

Docs: https://docs.tiledb.com

Blog: https://tiledb.com/blog

Our headquarters are located in Cambridge, MA and we have a subsidiary in Athens, Greece. We offer the ability to work remotely. If you are located outside of the USA and Greece we have options to accommodate this, don't hesitate to apply!

We have several open positions aimed at increasing TileDB’s feature set, growth and adoption. You will have the opportunity to work on innovative technology that creates impact on challenging and exciting problems in Genomics, Geospatial, Time Series, and more. Immediate features on the roadmap for TileDB Cloud include, expanded marketplace functionality, advanced computation pushdown, improved multi-cloud deployments and more.

We are actively seeking:

- Senior Golang Engineer

- Senior C# Engineer

- Site Reliability Engineer

Apply today at https://tiledb.workable.com !

[Disclaimer: I work for TileDB, Inc]

We have developed just this[1] except using a MariaDB storage engine (MyTile) we've written. You can serverless run queries against TileDB arrays without spinning up a MariaDB instance. You can run any type of query MariaDB supports (joins, aggregates, CTE, etc). I've linked the basic documentation and an example notebook below[2]. You can run SQL queries from python/R or even JS or curl. We support a number of data return formats, i.e. arrow and JSON to facilitate use cases.

I'll also mention that we have a number of public example dataset[3] in TileDB cloud, such as the NYC taxi data used in this notebook[4], which you can explore!

[1] https://docs.tiledb.com/cloud/api-reference/serverless-sql

[2] https://cloud.tiledb.com/notebooks/details/TileDB-Inc/Quicks...

[3] https://cloud.tiledb.com/explore/arrays

[4] https://cloud.tiledb.com/notebooks/details/TileDB-Inc/tutori...

TileDB, Inc. | Full-Time | REMOTE | USA | Greece | https://tiledb.com

TileDB, Inc. is the company behind TileDB, the first universal data engine. TileDB allows analytics professionals and data scientists to access, analyze, and share complex data sets with any tool at extreme scale. TileDB overcomes the constraints of columnar tables, flat files, and SQL-only tools, handling all data with a multi-dimensional array engine and extreme interoperability across the data science ecosystem. TileDB Cloud is a totally serverless offering of TileDB, which delivers access control and enables distributed computing at planet-scale, eliminating all cluster management and minimizing cost. TileDB, Inc. was spun out of MIT and Intel Labs in May 2017 and closed a $15M Series A in July 2020, following a previous $4M Seed Round.

Recent HN article: https://news.ycombinator.com/item?id=23896131

Website: https://tiledb.com

GitHub: https://github.com/TileDB-Inc/TileDB

Docs: https://docs.tiledb.com

Blog: https://tiledb.com/blog

Our headquarters are located in Cambridge, MA and we have a subsidiary in Athens, Greece. We offer the ability to work remotely, but the candidates must reside either in the US or in Greece. US candidates must be US citizens, whereas Greek candidates must be Greek or EU citizens.

We have several open positions aimed at increasing TileDB’s feature set, growth and adoption. You will have the opportunity to work on innovative technology that creates impact on challenging and exciting problems in Genomics, Geospatial, Time Series, and more. Immediate features on the roadmap for TileDB Cloud include, optimizing our serverless framework, improving integration with JupyterLab, and integrations with Machine Learning frameworks.

We are primarily seeking:

- Engineering Project Manager

- Developer Advocate

- Senior Golang Engineer

- And many more!

Apply today at https://tiledb.workable.com !

TileDB, Inc. | Full-Time | REMOTE | USA | Greece | https://tiledb.com

TileDB, Inc. is the company behind TileDB, the first universal data engine. TileDB allows analytics professionals and data scientists to access, analyze, and share complex data sets with any tool at extreme scale. TileDB overcomes the constraints of columnar tables, flat files, and SQL-only tools, handling all data with a multi-dimensional array engine and extreme interoperability across the data science ecosystem. TileDB Cloud is a totally serverless offering of TileDB, which delivers access control and enables distributed computing at planet-scale, eliminating all cluster management and minimizing cost. TileDB, Inc. was spun out of MIT and Intel Labs in May 2017 and closed a $15M Series A in July 2020, following a previous $4M Seed Round.

Recent HN article: https://news.ycombinator.com/item?id=23896131

Website: https://tiledb.com

GitHub: https://github.com/TileDB-Inc/TileDB

Docs: https://docs.tiledb.com

Blog: https://tiledb.com/blog

Our headquarters are located in Cambridge, MA and we have a subsidiary in Athens, Greece. We offer the ability to work remotely, but the candidates must reside either in the US or in Greece. US candidates must be US citizens, whereas Greek candidates must be Greek or EU citizens.

We have several open positions aimed at increasing TileDB’s feature set, growth and adoption. You will have the opportunity to work on innovative technology that creates impact on challenging and exciting problems in Genomics, Geospatial, Time Series, and more. Immediate features on the roadmap for TileDB Cloud include, optimizing our serverless framework, improving integration with JupyterLab, and integrations with Machine Learning frameworks.

We are primarily seeking:

- Engineering Project Manager

- Developer Advocate

- Genomics C++ Engineer

- And many more!

Apply today at https://tiledb.workable.com !

TileDB, Inc. | Full-Time | REMOTE | USA | Greece | https://tiledb.com

TileDB, Inc. is the company behind TileDB, the first universal data engine. TileDB allows analytics professionals and data scientists to access, analyze, and share complex data sets with any tool at extreme scale. TileDB overcomes the constraints of columnar tables, flat files, and SQL-only tools, handling all data with a multi-dimensional array engine and extreme interoperability across the data science ecosystem. TileDB Cloud is a totally serverless offering of TileDB, which delivers access control and enables distributed computing at planet-scale, eliminating all cluster management and minimizing cost. TileDB, Inc. was spun out of MIT and Intel Labs in May 2017 and closed a $15M Series A in July 2020, following a previous $4M Seed Round.

Recent HN article: https://news.ycombinator.com/item?id=23896131

Website: https://tiledb.com

GitHub: https://github.com/TileDB-Inc/TileDB

Docs: https://docs.tiledb.com

Blog: https://tiledb.com/blog

Our headquarters are located in Cambridge, MA and we have a subsidiary in Athens, Greece. We offer the ability to work remotely, but the candidates must reside either in the US or in Greece. US candidates must be US citizens, whereas Greek candidates must be Greek or EU citizens.

We have several open positions aimed at increasing TileDB’s feature set, growth and adoption. You will have the opportunity to work on innovative technology that creates impact on challenging and exciting problems in Genomics, Geospatial, Time Series, and more. Immediate features on the roamap for TileDB Cloud include, optimizing our serverless framework, improving integration with JupyterLab, and expanding our marketplace functionality.

We are primarily seeking:

- Senior Golang Engineer

- Senior C++ Engineer

- Senior QA Engineer

- And many more!

Apply today at https://tiledb.workable.com !

My previous job was working for $major_telco in the US, I was in network (not RF engineering). I left right as the "5G" train was starting, however I did get training and have pretty decent familiarity with the implementation plan and 3GPP release 15, the first release with the official New Radio (NR) spec. I also have a large understanding of LTE (3GPP release 10-14), so I'm happy to dive as deep as anyone would like.

For the details below I'm going to not use the term "5G", 5G like 4G is marketing. The technical specifications that more or less make up "5G" are the 3GPP standards releases[1]. The 3GPP is the standards body that ratifies the wireless network standards that nearly the entire world uses. For this discussion I'll ignore alternatives since "5G" effectively means the 3GPP standard.

The standard of 3GPP Release 15 (and newer) are improvements and build off the existing standards of LTE (releases 8-14). Its an evolution of the standard, much like 3GPP Release 8 (first LTE release) was an evolution on Release 5-7 (HSDPA-HSDPA+). While release 15+ are evolutionary, they are not revolutionary in that there is no magically discovered new physics behind it. The improvements largely lie with increased support for higher modulation levels (256 QAM was introduced with Release 14 LTE-Advanced), increased spectrum efficiency (variable sized framing allowed across difference devices and upload/download), mixing upload/download division types (i.e. using TDD[2] for download and FDD[2] for upload), improved MIMO (up to 64x64 in massive MIMO), improved beam-forming and additional frequencies.

Some of these improvements in Release 15+ were available in Release 14 or unofficially rolled out in release 14 + NR draft. I know one carrier that was pushing 64x64 MIMO for TDD LTE.

The new frequencies, many in the "millimeter wave" range, will help with with congestion in the "football stadium". There are two main limitations in high capacity events, the first is backhaul. Have to connect the stadium back to the core, and this is _always_ a bottleneck. The second limitation is available spectrum. No matter how many antennas you have in the DAS, there is a physical limitation to the amount of data that can be sent over the frequencies. The new millimeter wave help here, because while its very short range, its large width allows for a significantly higher number of concurrent connections.

The new frequencies, along with increased efficiency in existing frequencies, plus core changes are the main driver for the "latency" and "bandwidth" improvements. The "connected cars" and "connected IoT to cell network" are just marketing/sales departments pushing for new customers. The main "advantage" "5G" brings here is an increased capacity in the network to handle this.

A few other notes, unlike "3G"->LTE, the upgrade to Release 15+ for carriers will be a lot smoother. First, everyone is now on LTE, aka the precursor so there is no CDMA/EVDO networks that are incompatible that need rip and replace + compatibility modes (ehrpd). Second "NR" is designed to be compatible and multiplexable with existing LTE/LTE-Advanced enodebs, this means in one area you can have NR and LTE towers, and the NR towers can broadcast LTE for devices that are LTE only. This was not the case with the original eNodeBs, which could not handle backwards compatibility without physically separate BTS/nodeBs. Third, the new core for release 15 is designed with backwards compatibility with existing enodeb's. Unlike the previous transition which required a new core that was largely incompatible due to major design changes. So with "NR" RAN elements and existing LTE enodeb's the core can be seamlessly upgraded without having to run two complete networks for multiple years like in the LTE transition.

[1] https://en.wikipedia.org/wiki/3GPP#Standards

[2] TDD-> Time Division Duplex, FDD -> Frequency division duplex. Most LTE networks are FDD, a few (i.e. Sprint, Softbank, China mobile..) have certain spectrum they use as TDD. The difference is with TDD, you use the same exact frequencies for upload and download but you divide the by time. So basically t0->t2 is for download, t3->t4 is upload, etc. With FDD the frequency or "band" is divided into to two parts, one for upload and one for download. There is no time division for FDD but you lose of the size of the channel.

TileDB, Inc. | Full-Time | REMOTE | USA | Greece | https://tiledb.com

TileDB, Inc. is the company behind TileDB, the first universal data engine. TileDB allows analytics professionals and data scientists to access, analyze, and share complex data sets with any tool at extreme scale. TileDB overcomes the constraints of columnar tables, flat files, and SQL-only tools, handling all data with a multi-dimensional array engine and extreme interoperability across the data science ecosystem. TileDB Cloud is a totally serverless offering of TileDB, which delivers access control and enables distributed computing at planet-scale, eliminating all cluster management and minimizing cost. TileDB, Inc. was spun out of MIT and Intel Labs in May 2017 and closed a $15M Series A in July 2020, following a previous $4M Seed Round.

Recent HN article: https://news.ycombinator.com/item?id=23896131

Website: https://tiledb.com

GitHub: https://github.com/TileDB-Inc/TileDB

Docs: https://docs.tiledb.com

Blog: https://tiledb.com/blog

Our headquarters are located in Cambridge, MA and we have a subsidiary in Athens, Greece. We offer the ability to work remotely, but the candidates must reside either in the US or in Greece. US candidates must be US citizens, whereas Greek candidates must be Greek or EU citizens.

We have several open positions aimed at increasing TileDB’s feature set, growth and adoption. You will have the opportunity to work on innovative technology that creates impact on challenging and exciting problems in Genomics, Geospatial, Time Series, and more. Immediate features on the roamap for TileDB Cloud include, optimizing our serverless framework, improving integration with JupyterLab, and expanding our marketplace functionality.

We are primarily seeking:

- Senior Golang Engineer

- Senior C++ Engineer

- Developer Advocate

- Senior QA Engineer

- And many more!

Apply today at https://tiledb.workable.com !

Apache Arrow 3.0 5 years ago

TileDB[1] supports both sparse and dense multidimensional arrays. We support returning data in arrow arrays or an arrow table as one of many ways we interoperate with computational tools. You can also access the data directly via numpy array, pandas, R data.frames and a number of integrations with MariaDB, Presto, Spark, GDAL, PDAL and more.

Disclaimer: I am a member of the TileDB team.

[1] https://tiledb.com/

TileDB, Inc. | Full-Time | REMOTE | USA | Greece | https://tiledb.com

TileDB, Inc. is the company behind TileDB, the first universal data engine. TileDB allows analytics professionals and data scientists to access, analyze, and share complex data sets with any tool at extreme scale. TileDB overcomes the constraints of columnar tables, flat files, and SQL-only tools, handling all data with a multi-dimensional array engine and extreme interoperability across the data science ecosystem. TileDB Cloud is a totally serverless offering of TileDB, which delivers access control and enables distributed computing at planet-scale, eliminating all cluster management and minimizing cost. TileDB, Inc. was spun out of MIT and Intel Labs in May 2017 and closed a $15M Series A in July 2020, following a previous $4M Seed Round.

Recent HN article: https://news.ycombinator.com/item?id=23896131

Website: https://tiledb.com

GitHub: https://github.com/TileDB-Inc/TileDB

Docs: https://docs.tiledb.com

Blog: https://tiledb.com/blog

Our headquarters are located in Cambridge, MA and we have a subsidiary in Athens, Greece. We offer the ability to work remotely, but the candidates must reside either in the US or in Greece. US candidates must be US citizens, whereas Greek candidates must be Greek or EU citizens.

We have several open positions aimed at increasing TileDB’s feature set, growth and adoption. You will have the opportunity to work on innovative technology that creates impact on challenging and exciting problems in Genomics, Geospatial, Time Series, and more. Immediate features on the roamap for TileDB Cloud include, optimizing our serverless framework, improving integration with JupyterLab, and expanding our marketplace functionality.

We are primarily seeking:

- Senior Golang Engineer

- Senior C++ Engineer

- Senior UI/UX Web Designer

- Developer Advocate

- Senior QA Engineer

- And many more!

Apply today at https://tiledb.workable.com !

TileDB, Inc. | Full-Time | REMOTE | USA | Greece | https://tiledb.com

TileDB, Inc. is the company behind TileDB, the first universal data engine. TileDB allows analytics professionals and data scientists to access, analyze, and share complex data sets with any tool at extreme scale. TileDB overcomes the constraints of columnar tables, flat files, and SQL-only tools, handling all data with a multi-dimensional array engine and extreme interoperability across the data science ecosystem. TileDB Cloud is a totally serverless offering of TileDB, which delivers access control and enables distributed computing at planet-scale, eliminating all cluster management and minimizing cost. TileDB, Inc. was spun out of MIT and Intel Labs in May 2017 and closed a $15M Series A in July 2020, following a previous $4M Seed Round.

Recent HN article: https://news.ycombinator.com/item?id=23896131

Website: https://tiledb.com

GitHub: https://github.com/TileDB-Inc/TileDB

Docs: https://docs.tiledb.com

Blog: https://tiledb.com/blog

Our headquarters are located in Cambridge, MA and we have a subsidiary in Athens, Greece. We offer the ability to work remotely, but the candidates must reside either in the US or in Greece. US candidates must be US citizens, whereas Greek candidates must be Greek or EU citizens.

We have several open positions aimed at increasing TileDB’s feature set, growth and adoption. You will have the opportunity to work on innovative technology that creates impact on challenging and exciting problems in Genomics, Geospatial, Time Series, and more. Immediate features on the roamap for TileDB Cloud include, optimizing our serverless framework, improving integration with JupyterLab, and expanding our marketplace functionality.

We are primarily seeking:

- Senior Golang Engineer

- Senior C++ Engineer

- Senior UI/UX Web Designer

- Developer Advocate

- Senior QA Engineer

- Technical Support Engineer

- And many more!

Apply today at https://tiledb.workable.com !

TileDB, Inc. | Full-Time | REMOTE | USA | Greece | https://tiledb.com

TileDB, Inc. is the company behind TileDB, the first universal data engine. TileDB allows analytics professionals and data scientists to access, analyze, and share complex data sets with any tool at extreme scale. TileDB overcomes the constraints of columnar tables, flat files, and SQL-only tools, handling all data with a multi-dimensional array engine and extreme interoperability across the data science ecosystem. TileDB has a totally serverless infrastructure, which delivers access control and enables distributed computing at planet-scale, eliminating all cluster management and minimizing cost. TileDB, Inc. was spun out of MIT and Intel Labs in May 2017 and has just closed a $15M Series A, following a previous $4M Seed Round.

Recent HN article: https://news.ycombinator.com/item?id=23896131

Website: https://tiledb.com

GitHub: https://github.com/TileDB-Inc

Docs: https://docs.tiledb.com

Blog: https://tiledb.com/tiledb

Our headquarters are located in Cambridge, MA and we have a subsidiary in Athens, Greece. We offer the ability to work remotely, but the candidates must reside either in the US or in Greece. US candidates must be US citizens, whereas Greek candidates must be Greek or EU citizens.

We have several open positions aimed at increasing TileDB’s feature set, growth and adoption. You will have the opportunity to work on innovative technology that creates impact on challenging and exciting problems in Genomics, Geospatial, Time Series, and more. A few features on the roadmap include enhancing our TileDB Cloud offering, such as going true multi-cloud, optimizing our serverless framework, adding ML pipelines, and improving integration with JupyterLab.

We are primarily seeking:

- Developer Advocate

- Backend Engineer (golang, k8s, redis)

- Senior DevOps Engineer

- GeoScience Developer

- Many more!

Apply today at https://tiledb.workable.com !

Disclaimer: I'm a member of the TileDB team.

embedded, immutable, syncable relational database.

TileDB Embedded (https://github.com/TileDB-Inc/TileDB) checks all four of these boxes. It is a universal storage engine based on dense and sparse multi-dimensional arrays. I explain each point below.

embedded

TileDB Embedded [1] is an open source (MIT licensed) embeddable C++ library which exposes C and C++ APIs. We also built APIs for Python, R, C++, Java and Go, and integrations into MariaDB, PrestoDB, Spark, GDAL, PDAL and more. Via MariaDB we even have embeddable SQL[2]. TileDB abstracts the storage backends behind an extendible VFS class, and currently supports S3, GCS, Azure, HDFS, and local disk.

immutable

TileDB is designed around immutable objects. Every write creates a new "fragment" using a MVCC model[3]. No file is ever updated in place. TileDB is designed to naturally handle the eventual consistency and restraints of cloud object stores. This allows for features like multi-reader/multi-writer support, time traveling, and update support all within the storage engine without any external orchestration.

syncable

TileDB's MVCC approach to handling the eventual consistency of cloud object stores, yields directly into its sync-ability. Every write operation in TileDB creates a new "fragment" [3]. A fragment is an immutable folder (or prefix on object stores) that contains all the data from a single write session. Fragments are created with a timestamp and a UUID to ensure uniqueness. The fragment is ignored until a special `.ok` file is available in listing (each write is atomic). Incomplete fragments (without the .ok file) are gracefully ignored.

This means that every fragment is self-contained and syncable. The only requirement is that the special `.ok` file must show up only after the complete fragment folder is synced. With cloud object stores this is not a problem with the read-after-write consistency guarantees. For other systems the synchronization can be managed to handle this behavior.

relational database

Tables can be easily modeled as multi-dimensional sparse arrays[4]. Through TileDB's integrations with MariaDB and PrestoDB (and Spark), you gain a full SQL interface, while being able to query the data directly via the language APIs without using SQL. For more robust features, such as foreign key enforcement, it is easy to use embeddable MariaDB to achieve this, while we work to push such features into the storage engine itself. We are always seeking feedback on which features are most used and requested to pushdown common operations to the storage engine.

[1] https://tiledb.com/embedded

[2] https://docs.tiledb.com/main/api-usage/embedded-sql

[3] https://docs.tiledb.com/main/basic-concepts/physical-storage

[4] https://docs.tiledb.com/main/handling-dataframes

5G Just Got Weird 6 years ago

Millimeter wave frequencies are just one aspect of "5G", the standard of 3GPP Release 15 (and newer) are improvements and build off the existing standards of LTE (releases 8-14). Its quite possible, and likely that "5G" will be deployed across all existing spectrum, including lower frequency. Much like LTE has been and continues to be deployed across existing spectrum that was 2G/3G.

The focus on millimeter wave is large part due to existing capacity problems in high density areas, or for high bandwidth applications.

Yes this looks like a workable problem. We've reached out to their support. I'm seeing if I refresh the page 4-5 times I get it to finally load. Apologize for the inconvenience!

We are also looking for several geospatial/geoscience positions including a PostgreSQL developer to take advantage of pluggable storage for PostGIS usage with TileDB.

The 4a is looking nice, especially at the price point and for a "stock" android experience. I've started looking for a replacement to my Essential PH-1 since my USB port is getting very loose, and charging is becoming difficult. I wonder if there will be a demand for people who got the PH-1 on fire sale? This price point to features is what we've been missing since the early nexus days. The 3a was a nice step in this direction, but this looks like a very solid competitor in this field.

TileDB, Inc. | Full-Time | REMOTE | USA | Greece | https://tiledb.com

TileDB, Inc. is the company behind TileDB, the first universal data engine. TileDB allows analytics professionals and data scientists to access, analyze, and share complex data sets with any tool at extreme scale. TileDB overcomes the constraints of columnar tables, flat files, and SQL-only tools, handling all data with a multi-dimensional array engine and extreme interoperability across the data science ecosystem. TileDB has a totally serverless infrastructure, which delivers access control and enables distributed computing at planet-scale, eliminating all cluster management and minimizing cost. TileDB, Inc. was spun out of MIT and Intel Labs in May 2017 and has just closed a $15M Series A, following a previous $4M Seed Round.

Recent HN article: https://news.ycombinator.com/item?id=23896131

Website: https://tiledb.com

GitHub: https://github.com/TileDB-Inc

Docs: https://docs.tiledb.com

Blog: https://tiledb.com/tiledb

Our headquarters are located in Cambridge, MA and we have a subsidiary in Athens, Greece. We offer the ability to work remotely, but the candidates must reside either in the US or in Greece. US candidates must be US citizens, whereas Greek candidates must be Greek or EU citizens.

We have several open positions aimed at increasing TileDB’s feature set, growth and adoption. You will have the opportunity to work on innovative technology that creates impact on challenging and exciting problems in Genomics, Geospatial, Time Series, and more. A few features on the roadmap include enhancing our TileDB Cloud offering, such as going true multi-cloud, optimizing our serverless framework, adding ML pipelines, and improving integration with JupyterLab.

We are primarily seeking:

- Developer Advocate

- Backend Engineer (golang, k8s, redis)

- C++ Engineer

- Python Engineer

Apply today at https://tiledb.workable.com !

Seth from TileDB here. There are several differences from Redis or S3.

Redis is primarily a in-memory key-value store. There is an option for persistence but it's not primarily designed for persisting data. TileDB is designed first and foremost for persisting data to disk or to a cloud object store. Redis does not directly/natively support persisting to cloud object stores, as it's not really in the design goals. Another difference is TileDB is a column store designed around dimensions (~primary index) and attributes (non-indexes columns), where redis is a key-value with several data types but effectively its single value (that is one key equals one value, it might be a list type, but you can't have 1 key equal to a structure or multiple datatypes). You must serialize your data structures to fit into the key-value or you need to keep track of multiple keys and indexes if you want to approximate a columnar storage using lists. Depending on your application and use case Redis and TileDB are more likely to complement each other than you to select one over the other.

Using S3 directly, either with parquet or flat files is an option and one that is widely used. The problem we see with this is the fact that neither parquet nor flat files are designed for cloud objects stores and they leave a lot up to the application to implement since there is no single storage engine designed around any of these formats. This is why we've seen in the community over the last few years additional frameworks come about such as Delta Lake, Iceberg, Hudi and others. These systems are built to help facilitate the eventual consistency of cloud object stores, the multi-writer/multi-read problem and handling things like updates and deletes. By contrast TileDB has many of the features that are needed built directly into the format design and into the storage engine. TileDB's MVCC design instead of a single file allows it to natively handle updates and insertions with cloud object stores. We have designed it with the eventual consistency in mind, and are safe from corrupt reads or writes without the need for a central locking or transaction system.

In addition to the advantages we believe the TileDB storage engine has with S3, I also want to mention that one of the main issues we wanted to solve with TileDB Cloud was sharing and access control of S3 data sets. S3 access policies do exist and can be used to facilitate sharing of objects with other users/accounts/public. However anyone who has dealt with the S3 policies has seen that they can grow quickly and become unwieldy as you try to limit different prefixes. It seems like many times companies end up making a bucket public to share the data instead of managing the access policies, and we all see the various data leaks that happen as a result. With TileDB Cloud we offer very easy and simple sharing capabilities. From our web console we aim for it to be trivial to select an array, and share it with another user, organization or even to make it public. [1]

For some quick examples, we do have some example jupyter notebooks for running python examples [2]. These are also available on TileDB Cloud, if you sign up we are giving $10 of free credit and you are able to launch a jupyterlab instance and see these examples preloaded. We also have some quickstart examples in different languages if you prefer something other than Python [3]. The quickstarts are not full use cases but they do give you an overview of basic API usage. I'd love to get some feedback from you on what type of lightweight examples you are looking for. We are always aiming to improve our documentation and make it easier to discover about TileDB.

[1] https://docs.tiledb.com/cloud/console/arrays/sharing-arrays

[2] https://github.com/TileDB-Inc/TileDB-Cloud-Example-Notebooks...

[3] https://docs.tiledb.com/main/quickstart

TileDB is designed around supporting multiple compressors or filters. We have architected the code so that we can add different filters as we find use cases or customer requests. Currently we support compressors such as gzip, bzip2, zstd, lz4 and also filters like double-delta, byteshuffle or and RLE. For a complete list see our docs[1]. Adding support for specific image compressors such as JPEG or video codecs is on our roadmap.

[1] https://docs.tiledb.com/main/basic-concepts/tile-filters