After the years, I've arrived at the conclusion that everything can be scrapped. What you have to do is try to put as many walls as you can. But if someone really wants to crawl your site, with the right knowledgement he will able to do it despite of all your walls.
HN user
jordif
Good article! I been doing scraping for the last 10 years and I've seen a lots of differents things to try to avoid us. Also, I'm in the other side protecting websites to ban scrapers, so funny!
In the times where most of the things are cloud tools, what are the advantages of having a WP APP installed in the laptop instead of using the native backoffice? Thanks!
You can have different problems. - Server requirements too low to handle your daily traffic - WP custom development with slow querys - Are you using any caching system and image optimization?
One of the best option is Digital Ocean. You can configure a Droplet (server) with a WP setup without any skill in linux or sysadmin. Their first price is €5/month. Their customer service is very good in any price, and their documentation too.
I really don't recomment GoDaddy, their hosting is very slow.
I use a lot Amazon suggestions based on my last orders and also friends referrals.
This is a great topic. We can think in this solution or in the Elon Musk solution, about that every person must to be a salary, working or not. I don't know what solution should be, but this is one of the main topic for the next decade.
Actually no time :)
I use to go to hackathons for few reasons: 1. To have fun developing a new product and coding 2. Meet new and interesting people 3. Look at people skills for when I'm hiring for my company
What tools are you using?
Every messenger apps (fb messenger, slack, telegram, skype) has its own chatbot directory list. Also, for example in fb messenger, you can run fb ads campaign to promote your bots, but the convertion rates are not very well.
In my case, I use the bots who helps me in two ways: - News. I use it like a service to receive the latest news once per day. - Productivity. I use some slack bots that it helps me for productivity and also my team.
Like the apps, if the bot is useful for the users, they will use it.
I've been trying Hipmunk's last week and I think that it helps a lot if you are looking for flights or hotels, but it needs a lot of improvements to try to understand the user. For example, the chatbots comes into a loop many times :) But anyway, I think that this bot is a very good approach at what will be the future of booking flights and hotels.
I really recommend to use a hosted ecommerce platform to test the market for new sites and make a good and fast MVP. Once the ecommerce administrator has experiencie, he would know what he needs to manage an ecommerce site. This is the moment to switch to a self-hosted platform. If you are in this step, it means that the MVP works well and you are investing in a website that it seems to fit into the market.
Wordpress is used for more than 25% of internet sites. That also means that is the CMS most hacked :)
Fortunately the WP and its community is working hard to fix the problems asap and make new release.
The major problem is that people doesn't update the cms. I really recommend the auto-updated and a good management of all plugins versions. If you are a delveoper and you are taking care of several wp sites, there are many plugin that can help you to manage the WP and plugins versions for a large number of sites.
I've been moving different platforms to HTTPS. Despite of some minors problems, you have to take care about all the content embed in the website (videos, iframes, etc.) that is not https. All of these content will be not available when you switch your website to https. So, before to do that, list all the content non https and try if it works with using https protocol.
For me the morning route give me the power and focus for all the day, so it's very important.
I wake up at 5:30 and I meditate for 5-10 minutes. After that I eat, I check the Slack to see if I have any important request from the team during the day (we are in three different timezones, Spain, Japan, SF). I prioritize and add to the calendar my day tasks (if I have to do a task, it means that is important and it has to be schedule in a proper time to put focus on it).
After that I do sport from 7 to 8. Sometimes I go to the gym for some cardio exercise and another times just for a 30-45min run.
I arrive to the office at 08:15.
I think that the morning routine is one of the most important parts of the day. It can helps you to have a lot of will power!