Smart line numbers should set absolute line numbers when disabling the plugin

[morriscurtis]

I really love to have absolute line numbers in insert mode and relative line numbers otherwise.
This is what Smart Line Numbers is doing and it works mostly. But when you disable the extension, it always returns to relative numbers, even if you were in Insert-Mode before.
It should default to absolute line numbers in that case.