HN user

kateklink

116 karma
Posts13
Comments32
View on HN

for pass@1 HumanEval tells how well the model solves a task from a set, given only one chance to solve it. It's not the perfect metric, there're other like DS-1000, MBPP (we have included them on HuggingFace model card). HumanEval is good for benchmarking with other models as it gives a fast idea how powerful the model is.

we want to help developers who need either on-premise or permissive code assistant, copilot has neither of this. We also wanted to lower the barriers for self-hosting, so that the model is available on most GPUs with just 3GB Ram. Plus making the code completions fast and efficient (understanding entire context, not just the previous tokens).

We’ve finished training a new code model Refact LLM which took us about a month. The main use-case is for blazing-fast code completion with fill-in-the-middle, additionally, the model could reply to chat prompts.

It has much better performance than all of the code models of similar size, and almost reaches the same HumanEval as Starcoder being 10x smaller in size.

With the small size, it can work with most modern GPUs requiring just 3GB Ram.

You can try self-hosting it in Refact https://github.com/smallcloudai/refact/ and get a local fast copilot alternative with decent suggestions.

Weights and model card https://huggingface.co/smallcloudai/Refact-1_6B-fim.

We would love to hear your feedback!

Refact.Ai | https://refact.ai | Developer Advocate | Software Engineer | Remote (UK & Europe) | 80 - 120K + equity

We're building the best open-source AI for coding using all the best LLMs available in the internet (GPT, Starcoder, WizardCoder, LLama2).

We’re hiring for Refact’s first Developer Advocate. As the first Developer Advocate, you'll play a key role in helping developers use the power of AI for coding. You'll have the opportunity to grow and support a community of developers who are excited about the future of AI and open-source.

We're looking for a Software Engineer to help us build the best developer experience for the AI code assistants inside IDEs. We currently have VS Code and Jetbrains plugins and plan to add more IDEs and more functionality to the plugins.

Apply: Developer Advocate https://wellfound.com/l/2yXwiJ

Software Engineer: https://wellfound.com/l/2zdYHM

Hi HN! At Refact, we're building an open-source AI Code assistant with fine-tuning focused on providing the enjoyable coding experience without privacy concerns. Why? When you look at AI code tools like Copilot, you'll notice that they often provide generic coding suggestions because the models were not trained on your codebase. They also only work in the cloud, so in order to get a code suggestion, you need to send your code to the cloud provider. One of the solutions for this is self-hosted fine-tuning on codebase, but the companies who provide this feature currently prioritize it for enterprise making it difficult for individual devs to use it. We want to change that by open-sourcing fine-tuning for everyone, not just enterprise customers. Currently with Refact you can self-host Refact models and the best open-source LLMs (like StarCoder, LLama2, WizardLM) and use it for code suggestions and chat. We would love to hear your ideas and feedback on your current experience with AI code assistants and what is currently missing!

We're currently building a tool, which uses Linkedin API, and I performed a fair amount of customer interviews about their use of professional network and, well, Linkedin. A popular opinion of what I've heard is "Linkedin is dead", cause it's very old-school and not flexible to adapt to changes. People use it for just adding contacts, sometimes randomly, and then they rarely do anything with them. Recently they announced the restrictions to their API program, meaning that new cool tools, which try to make more sense of Linkedin data, will not be able to use Linkedin data anymore. I guess, that will make it even more unpopular for users.

Check out BrightLocal blog - they have good resources about Local SEO https://www.brightlocal.com/blog/ Also you can check tools for Local SEO at http://www.whitespark.ca/ From my experience the main success factors in Local SEO are G+, maps, homogeneity of addresses, links and mentions in local blogs and services. Also the big weight is reviews in social networks and yellow pages. And you should constantly track & analyze competitors