What is robots.txt? | Advantages and disadvantages when using Robot.txt

What is Robot.txt? Robots.txt is a special text format that is not HTML or any other type…