Understanding Root Mean Square Prop or RMSprop Algorithm

Root mean square prop or RMSprop is using the same concept of the exponentially weighted average of the gradients like gradient descent with momentum but the difference is the update of parameters. This article shall explain the algorithm in a simple understandable way.