what is a robots.txt file and how it affects search engine indexing

webmaster tools robots.txt console

The robots.txt is a text file that resides in the top level folder on your webserver. The purpose of the robots.txt file (or just robots file) is to provide some guidance to search engine crawlers as to what should be crawled and indexed, and what content should not be crawled. The robots.txt file uses an exclusion standard, which means that you…

4 advanced calculators that you can use from linux command line

qalc or qalculate calculator in linux command line

Almost all modern day Linux distros come with a calculator application by default, unless you use Gentoo, Arch or a similar distro. Most times such GUI based calculator are sufficient to do some quick calculations. However you may not have access to a GUI based system all the time, and you would want to use a command line based calculator…

how to change the default ssh port in linux

linux change default port

One of the best ways to connect to a remote machine is by using the ssh protocol. Secure Socket Shell (or ssh) is a cryptographic network protocol that allows you to securely connect to a remote machine. It also refers to a suite of utilities that implement the protocol, such as the ssh server and an ssh client. In order for…

how to delete private data from mozilla firefox when you close the browser

firefox custom privacy

Mozilla Firefox is one of the most popular web browsers in the world. As with any web browser there is a lot of data collected as you browse the web. These set of data contains many different types of information: the browsing history, the site cookies, the cache, and personal data among others. Many times you might want to delete…

how to find all files containing specific text in a linux filesystem?

search text in file content with grep

Most search utilities work by crawling, parsing and generating an index of the file content so that they can be searched later. Many operating systems and desktop environment follow this approach to make searching faster. We will see how to search through file content from the command line, without the use of such indexes or engines. Needless to say, these…

how to forward ports on a network router

port forwarding for age of empiers

Network Routers are an integral part of your home network. Most applications and services works without having to open up ports on your router. But sometimes there are some applications, such as multiplayer games, p2p networks and web servers that necessitates the need for certain ports to be open or forwarded so that they can function correctly. The network router…

7 of the best web browsers that you can use in linux

vivaldi browser in linux

Everybody needs a web browser. The web browser is probably one of mostly widely used tools in this day of cloud computing and internet. Google even made an operating system out of a browser. What browser you use depends much on its feature set and your own preferences. Almost all of the popular web browser today, have a very similar…

how to change the document root directory in apache web server in linux

document root in apache web server

The Apache Web Server is one of the most popular web servers that is used both in development and production. As per the latest count, it boasts close to 50% of the market share. There are many reasons as to why the Apache server is popular. It is easy to install, configure and run. It is pretty light weight and…

how to sort the output of ‘top’ command by memory or cpu usage

linux top command sorted by cpu

One of the programs that you can use to quickly see the process information is the top command. The fact that the command can be run from virtually any command prompt and it is self updating makes it a handy tool. You can quickly find the processes that are consuming too much resources on the machine. In most cases, running…

how to sort du command output by size in linux

sorting du output in linux

If you use a Linux system often enough, you should already be familiar with the du command. The du command allows you to check or print the file space usage. You can use it to print out the current disk usage for a set of files and folders. The ability to print out folders sorted by size can be useful when…

how to get current date and time inside a shell script

date and time in shell

When writing shell scripts, many times you would want to get the current time and date, that is the date and time when the script is getting executed. This value can be saved to a variable and used through out the script for various different purposes. You can use them to generate informative file names or even other variables. You can…