HN user

gioark

7 karma

software engineer at internet archive

twitter: https://twitter.com/giovannidamiola

Posts0
Comments4
View on HN
No posts found.
[GET] "/api/user/gioark/stories?hitsPerPage=30&page=0": 500 Failed to fetch user stories

hi, I am the author of the article.

@devhead: To import the data into ES we used a custom application to extract the text from the OCR'd documents. This is required to support our bookreader software. A complete ingestion takes a few days; we rate-limit indexing in order not to overload the cluster, and maintain reasonable search performance.