Technical SEO Checklist for New Websites
A practical technical SEO checklist for new websites in the UAE and Sri Lanka: robots.txt, sitemaps, canonicals, HTTPS, schema, and Core Web Vitals.

A technical SEO checklist for a new website covers six essentials: confirm crawlability with a clean robots.txt file, submit an XML sitemap, set correct canonical tags, add structured data, enforce HTTPS, and pass Core Web Vitals. Completing these checks at launch prevents the most common failure for new domains — pages that never get indexed at all.
What is technical SEO and why does it come first?
Technical SEO is the work of making a website easy for search engines to crawl, render, understand, and index. It comes first because content and links only count once a page is in Google's index. For a new business website in Dubai, Abu Dhabi, Sharjah, or Colombo, this matters even more: a new domain has no authority yet, so search engines visit it infrequently, and any crawl block, redirect loop, or duplicate-content issue can stall indexing for weeks. Industry guidance from Google and Bing is consistent on the order of operations — fix the technical foundation before investing heavily in content or link building.
How do you make a new website crawlable?
You make a site crawlable by allowing search engines in robots.txt, removing leftover noindex tags from staging, and linking every important page from at least one other page. Run these checks the day your site goes live.
- Check robots.txt at yourdomain.com/robots.txt. It must not contain "Disallow: /" and must not block your CSS or JavaScript files, which Google needs to render pages correctly.
- Search the source code for "noindex". Many sites launch with a staging-era meta tag that excludes every page from search results — a single sitewide noindex can hide an entire website.
- Build a flat internal link structure. Every key page should be reachable within a few clicks of the homepage through normal HTML links, not JavaScript-only menus.
- Fix broken links and redirect chains. Crawlers waste crawl budget on 404 errors and long redirect hops, which slows down indexing of your real content.
Use the URL Inspection tool in Google Search Console to test any page.
How do you get a new website indexed faster?
Indexing speeds up when you submit an XML sitemap, request indexing for priority pages, and keep the signals between those files consistent. A sitemap does not force indexing, but it removes guesswork about which URLs exist.
- Create an XML sitemap at yourdomain.com/sitemap.xml listing only canonical, indexable, HTTP 200 URLs — no tag archives, thank-you pages, or duplicates.
- Submit it in Google Search Console and Bing Webmaster Tools. Bing matters in this region because it powers search products that some users in the UAE and Sri Lanka rely on.
- Use "Request Indexing" on your homepage and money pages — services, products, contact — rather than requesting every URL one by one.
- Keep the sitemap updating automatically; most CMS plugins regenerate it whenever you publish new content.
For multilingual sites — common in the UAE, where English and Arabic pages often run side by side — add hreflang annotations so each language version targets the right audience, and include every language variant in the sitemap.
Which canonical and duplicate-content checks should you run before launch?
Canonical tags tell search engines which version of a URL is the official one, and a wrong canonical is among the most damaging launch mistakes because it can de-index your own pages. Verify the following before you promote the site.
- Every indexable page has a self-referencing canonical in its head section.
- Canonicals point to the final HTTPS domain you want ranked — never to a staging domain, an http:// URL, or the old site.
- One domain version is canonical: choose https with or without www and 301-redirect all other versions to it, including any temporary hosting URL.
- Filtered, sorted, or parameterised URLs either canonicalise to the clean version or are kept out of indexing.
Also confirm every page has a unique title tag and meta description; duplicate titles confuse both crawlers and searchers.
Why are HTTPS and structured data non-negotiable?
HTTPS protects user data and is a confirmed, though lightweight, Google ranking signal; structured data is markup that helps Google understand your pages and qualify them for rich results. New sites in competitive UAE and Sri Lanka markets need both, because browsers now label non-HTTPS pages "Not secure," which erodes trust for e-commerce and lead generation.
- Install a valid SSL certificate and 301-redirect every http:// URL to https:// so duplicate versions never circulate.
- Remove mixed content — images or scripts still loading over http trigger browser warnings.
- Add schema that matches the page: Organization and LocalBusiness for company details, Product with pricing for online shops, FAQPage for question-led pages, and Article for blog posts.
- Validate with Google's Rich Results Test and fix errors before launch; invalid markup is simply ignored.
How do Core Web Vitals affect a new website?
Core Web Vitals are Google's page-experience metrics: Largest Contentful Paint for loading, Interaction to Next Paint for responsiveness, and Cumulative Layout Shift for visual stability. They act as a tie-breaker in competitive results — and on the mobile-heavy networks common across the UAE and Sri Lanka, slow or unstable pages lose visitors before they read a word.
- Compress and resize images, serve them in WebP or AVIF, and lazy-load everything below the fold; oversized hero images are the most common cause of poor loading scores on new sites.
- Minify CSS and JavaScript and remove unused plugin scripts, because every render-blocking file delays the first paint.
- Reserve space for ads, embeds, and late-loading elements to keep layout shift close to zero.
- Use caching and a CDN with servers close to your audience so pages load quickly in Dubai, Abu Dhabi, and Colombo alike.
Test representative pages with PageSpeed Insights; a faulty template repeats its problems across every page built from it.
What does the final technical SEO checklist look like?
Here is the condensed launch checklist, in the order you should complete it:
- Crawlability: clean robots.txt, no stray noindex tags, HTML links to every key page.
- Indexing: XML sitemap submitted in Search Console and Bing, priority URLs requested for indexing.
- Canonicals: self-referencing tags, one HTTPS domain version, 301 redirects from all alternates.
- HTTPS: valid SSL certificate, full redirects, no mixed content.
- Structured data: Organization, LocalBusiness, Product or FAQ schema, validated.
- Core Web Vitals: compressed images, minified code, caching and CDN, mobile-first templates.
- Monitoring: Search Console verified and sitemap coverage reviewed weekly for the first month.
If you would rather hand this to specialists, [Webnet's web design and SEO services](https://webnet.lk/services) include technical audits and launch reviews for businesses across Sri Lanka and the GCC — or simply [contact the team](https://webnet.lk/contact-us) before you go live.
Frequently asked questions
How long does it take for a new website to get indexed?
Most new websites are indexed within a few days to a few weeks after launch, provided the sitemap is submitted and priority URLs are requested in Google Search Console. Timing varies with site size, internal linking, and how often Google crawls the domain.
Do I need to resubmit my sitemap after every update?
No. Google re-reads submitted sitemaps periodically on its own. Resubmitting is only necessary after major changes such as a migration or a large batch of new URLs; an automatically regenerated sitemap keeps the file current in between.
Can one technical error stop a website from ranking?
Yes. A robots.txt rule that blocks the whole site, a leftover sitewide noindex tag, or canonicals pointing at the wrong domain can prevent pages from being indexed at all, regardless of content quality.
Is HTTPS required for SEO?
HTTPS is not required for indexing, but Google has confirmed it is a ranking signal, and browsers display "Not secure" warnings on http:// pages. Every new website should launch on HTTPS with all http:// URLs redirected.
Related services
Want this done for you?
Webnet implements everything in this article — and keeps it working, month after month.
How to Choose a Web Development Company in Sri Lanka
What to check: portfolio, process, SEO readiness, maintenance, and transparent pricing. This guide explains what matters, how to approach it,…
15 Nov 2026Website Speed Optimization for Sri Lankan Businesses in 2026
Fast websites rank better and convert more. For Sri Lankan businesses in 2026, improving Core Web Vitals, image delivery, hosting,…
14 Nov 2026Local SEO for Sri Lankan Businesses: A Practical Guide
A practical local SEO guide for Sri Lankan businesses: Google Business Profile setup, NAP consistency, reviews, local content and schema…
12 Nov 2026