By Craig Bailey
Published: Monday 28 September 2015 | Last updated: Tuesday 04 September 2018
Published: Monday 28 September 2015 | Last updated: Tuesday 04 September 2018
Each week we share our latest digital marketing and HubSpot experiments, findings, tips and strategies.
By Craig Bailey
Published: Monday 28 September 2015 | Last updated: Tuesday 04 September 2018
Setting the robots.txt file is important for your web site's health - Google uses it as a guide for what to index and what to exclude.
I've previously included references to the robots.txt file in this post on going live with a new elcomCMS site (see point 6) but it's worth covering again here.
In elcomCMS, setting the robots.txt file is really easy.
You can access it from the Admin menu:
and then edit it directly:
If a site is in staging, you'll ideally want to block Google from crawling it. Use the following to block the entire site:
User-agent: *
Disallow: /
Once the site is live, you only really want to block a few items eg blocking the login page is reasonably common. You can also block entire directories eg such as an FTP folder:
User-agent: *
Disallow: /cmlogin.aspx
Disallow: /ftp/
Be very careful when going live with a site - I often see sites go live (from staging) and keep their robots.txt file from staging - and in the process block their entire live site in Google! Make sure you check your robots.txt file when going live.
Published: Monday 28 September 2015 | Last updated: Tuesday 04 September 2018
In this episode, we dive into the best practices in building a campaign in HubSpot from start to finish from lists, landing pages to emails and more!
Switching to a business account is simple and can be done in just a few clicks on your mobile device or on a desktop. Here are the steps.
In this episode, we dive April 2022 Edition of HubSpot top tips from improving your HubSpot efficiency and impact to NPS survey reminder emails and more!
XEN partners with sales and marketing teams in B2B technology companies to deliver strategy, implement marketing technology and drive business growth through digital marketing campaigns.
HubShots is the podcast for marketing managers and sales leaders who use HubSpot. Listen to the latest episode here.
XEN is a HubSpot Platinum Certified Partner.
Phone: 02 8006 4428
404 / 56 Hercules Street
Chatswood NSW 2067
Australia