In insert mode, backpace doesn’t delete characters as intended. To fix this issue, add this configuration to the .vimrc as the following:

set backspace=indent,eol,start

Reference:

http://vim.wikia.com/wiki/Backspace_and_delete_problems