@mb themes,
I want to remove these folders from the search engine.
will this be the right method.
Googlebot indexed a blocked url, I already blocked the directories, like vendor,apps etc. but it's scanning.
can we just add noindex metatag, for all the pages in those directories.